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SUMMARY 

The  mathematical  theory  of  differential  games  is  used  to  study  the 
structure  of  optimal  allocation  strategies  for  some  time-sequential  combat 
games  with  combat  described  by  Lanchester-type  equations  of  warfare.   The 
work  reported  here  primarily  concerns  the  application  of  existing  differential 
game  theory  (including  some  recent  developments  of  the  author  on  necessary 
conditions  of  optimality  for  problems  with  state  variable  inequality  con- 
straints) for  the  determination  of  optimal  time-sequential  combat  strategies 
in  several  Lanchester-type  differential  games  of  tactical  interest.   Two 
time-sequential  problems  of  optimal  fire-support  allocation  are  considered: 
the  first  examines  the  determination  of  optimal  air-war  campaign  strategies 
within  the  context  of  ground-war  objectives,  while  the  second  examines  the 
determination  of  optimal  time-sequential  fire  distribution  strategies  for 
supporting  weapon  systems  (here  taken  to  be  artillery  or  naval  ship  gunfire) . 

In  previous  work  the  author  has  studied  optimal  air-war  campaign 
strategies  in  a  generalization  of  a  well-known  tactical  air-war  differential 
game  model.   This  work  extended  previous  work  by  considering  valuation  of 
surviving  air-war  assets  and  temporal  variations  in  both  the  effectiveness 
of  counter-air  operations  and  also  the  return  from  ground  support.   The 
differential  game  model  discussed  above  has  been  criticized,  however, 
because  it  does  not  evaluate  air-war  tactics  within  the  context  of  ground- 
war  objectives.   Consequently,  this  model  produces  suboptimization.   Hence, 
a  model  is  considered  which  is  considerably  broader  in  scope,  does  consider 
land-war  objectives,  but  (unfortunately)  is  considerably  less  susceptible 
to  closed-form  analytic  solution.   For  this  new  model  partial  results 
concerning  the  determination  of  optimal  campaign  strategies  are  obtained 
and  contrasted  with  those  for  the  model  previously  discussed  above. 
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The  determination  of  optimal  fire  distribution  strategies  for 
supporting  weapon  systems  is  a  major  problem  of  military  operations  research, 
The  author  has  studied  some  aspects  of  this  problem  in  previous  research. 
Motivated  by  a  paper  which  recently  appeared  in  the  open  literature,  optimal 
fire-support  strategies  are  studied  in  an  attack  scenario.   The  dependence 
of  optimal  fire-support  strategies  on  combatant  objectives  is  examined  for 
a  problem  previously  considered  in  the  open  literature:   necessary  and 
sufficient  conditions  on  the  functional  form  of  the  criterion  functional 
(terminal  payoff  only)  for  the  optimal  fire-support  strategies  to  be  inde- 
pendent of  force  levels  (at  least  for  a  certain  range  of  values)  are 
developed.   This  shows  that  certain  results  previously  reported  in  the 
literature  are,  in  general,  not  true.   A  variation  of  this  problem  is  then 
considered.   In  contrast  to  the  previous  work  reported  in  the  literature, 
the  attrition  structure  of  the  problem  at  hand  leads  to  the  optimal  fire- 
support  strategy  of  the  attacker  requiring  him  to  sometimes  split  his 
artillery  fire  between  enemy  infantry  and  artillery  (counterbattery  fire). 
Numerical  examples  are  given. 
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1.   Introduction. 

This  report  is  the  fourth  in  a  series  of  reports  which  document  the 
author's  research  on  the  structure  of  optimal  (time-sequential)  allocation 
policies  for  tactical  situations  described  by  Lanchester-type  equations  of 
warfare.   The  report  at  hand  contains  Appendices  C  and  D  of  the  author's 
previous  report  [10].   The  results  of  these  appendices  were  discussed  in 
general  terms  in  [10] ,  but  it  had  not  been  possible  to  publish  the  appendices 
themselves  at  that  time.   For  the  reader's  convenience,  portions  of  the  main 
body  of  the  report  [10]  are  reproduced  here  as  they  pertain  to  the 
work  at  hand.   It  should  be  understood  that  in  Appendices  C  and  D  of  the 
report  at  hand  when  reference  is  made  to  Appendices  A,  B,  and  E,  it  refers 
to  work  previously  published  in  IlO]. 

By  considering  several  combat  scenarios,  further  insights  have  been 
gained  into  such  important  questions  as: 

(1)  How  should  fire  be  distributed  over  targets? 

(2)  How  should  targets  be  selected? 

(3)  Do  target  priorities  change  over  time? 

(4)  Do  force  levels  affect  the  optimal  allocation  strategies? 

(5)  How  does  the  number  of  target  types  affect  the  optimal 
allocation  strategies? 

(6)  Do  conflict  termination  circumstances  affect  the  optimal 
allocation  strategies? 

(7)  How  are  the  optimal  fire  distribution/target  selection 
strategies  affected  by  the  nature  of  the  attrition 
processes? 

(8)  What  is  the  effect  of  logistics  constraints  on  such 
policies? 


(9)  How  does  the  uncertainty  and  confusion  of  combat  affect 
optimal  allocation  strategies? 
Specific  objectives  of  this  research  have  been  the  identification  of  decision 
parameters  and  the  further  development  of  general  principles  for  target 
selection,  regulation  of  firing  rate,  and  allocation  of  military  resources 
in  dynamic  combat  situations.   A  further  discussion  of  research  objectives 
and  their  relationship  to  defense  planning  problems  can  be  found  in  the 
author's  past  reports*  [8],  [9],  [10].   It  should  be  pointed  out  that  al- 
though the  quantitative  analysis  of  tactics  may  be  considered  to  be  a 
relatively  new  field  of  military  operations  research,  there  is  wide-spread 
interest  in  such  work  (see  [4],  [6],  [7],  [8],  [15]). 

Our  approach  has  been  to  combine  Lanchester-type  models  of  warfare 
with  generalized  control  theory  (both  deterministic  and  stochastic  optimal 
control,  dynamic  programming,  and  differential  games)  [9],  [13]  (see  also 
[14]).   This  has  been  done  by  considering  a  sequence  of  concrete  situations 
for  which  optimization  problems  were  formulated  and  solved  by  application  of 
the  mathematical  theory  of  differential  games.   The  structure  of  optimal 
time-sequential  fire  allocation  strategies  has  been  studied  by  considering 
the  solutions  for  specific  problems  and  comparing  and  contrasting  these. 

The  organization  of  this  report  is  to  discuss  results  in  general 
terms  in  the  main  body  and  to  leave  details  for  the  appendices. 

2.   Guided  Tour  of  the  Appendices. 

In  this  section  we  summarize  the  work  which  is  contained  in  the 
appendices  and  explain  why  this  work  was  done.   The  results  reported  here 


* 
A  comprehensive  review  of  pertinent  literature  prior  to  1973  in  the  fields 

of  (a)  Lanchester-type  models  of  warfare,  (b)  differential  games,  and  (c) 
optimal  control  of  Lanchester-type  attrition  processes  is  also  to  be  found 
in  19]. 


may  be  considered  to  be  extensions  of  our  earlier  work  [8],  [9],  [10],  [13]. 
Moreover,  the  work  at  hand  lays  the  foundations  for  more  extensive  work  on 
the  quantitative  analysis  of  tactics  and  applications  of  generalized  control 
theory  to  problems  of  military  operations  research. 

As  mentioned  above,  Appendices  A,  B,  and  E  have  been  published 
separately  in  [10].   The  report  at  hand  contains  only  Appendices  C  and  D. 

In  Appendices  B  and  C  we  apply  the  theoretical  results  of  Appendix 
A  to  the  study  of  optimal  air-war  strategies.   This  has  been  over  the  years 
a  problem  of  lasting  interest  for  defense  planners.   In  Appendix  B  we  consider 
a  generalization  of  the  tactical  air-war  game  of  A.   Mengel  [2]  (see  also 
[1])  in  which  aircraft  effectiveness  may  vary  over  time  and  a  residual  value 
for  aircraft  at  the  end  of  the  campaign  is  considered.   Optimal  strategies 
are  characterized  for  this  general  problem.   A  complete  solution  (i.e.  , 
explicit  determination  of  optimal  closed-loop  strategies)  is  given  for  cases 
of  constant  coefficients.   These  results  are  much  more  general  than  previous 
ones  and  provide  much  insight  into  trade-offs  between  various  planning 
parameters.   Preliminary  results  are  also  obtained  for  problems  in  which 
aircraft  effectiveness  in  the  air  war  is  constant  but  the  value  of  ground 
support  changes  over  time.   The  latter  is  an  attempt  to  reflect  the  influence 
of  combat  air  support  on  the  ground  war  and  hence  avoid  suboptimization.   Two 
cases  of  time-dependent  "returns"  from  ground  support  are  considered: 

(a)  linearly-decreasing-with-time  returns  from  ground  support, 

(b)  exponentially-decreasing^with-time  returns  from  ground 
support. 

One  criticism  that  has  been  made  of  the  model  considered  in  Appendix 
B  is  that  it  does  not  evaluate  air-war  strategies  within  the  context  of 
ground-war  objectives.   In  other  words,  this  model  (unfortunately)  produces 


suboptimization.   Thus,  in  Appendix  C  we  present  preliminary  results  for  a 
model  which  considers  the  development  of  optimal  air-war  strategies  within 
the  context  of  land-war  objectives.   These  preliminary  results  show  that 
the  outcome  of  the  ground  war  may  be  a  significant  factor  in  the  deter- 
mination of  optimal  air-war  strategies. 

The  research  reported  in  Appendices  B  and  C  was  undertaken  because 
an  important  question  for  defense  planners  is  what  are  appropriate  missions 
over  the  course  of  a  campaign  for  tactical  air  power.   The  answer  to  this 
question  has  far-reaching  implications  for  Navy  air  forces  (both  carrier- 
based  and  land-based)  and,  of  course,  the  Air  Force.   Recently,  the  USAF 
Studies  and  Analysis  Group  has  been  using  quantitative  methodology  [15]  in 
trying  to  answer  such  questions.   By  considering  the  results  given  in 
Appendices  B  and  C  one  can  begin  to  see  the  effects  of  the  nature  of  the 
combat  optimization  problem  on  the  structure  of  optimal  air-war  strategies. 

The  determination  of  optimal  fire  distribution  strategies  for 
supporting  weapon  systems  is  a  major  problem  of  military  operations  research. 
This  problem  is  particularly  of  interest  to  the  military  tactician  so  that 
he  may  have  a  clearer  understanding  of  the  circumstances,  for  example,  under 
which  enemy  infantry  should  be  engaged  by  a  supporting  weapon  system  (such 
as  artillery)  and  those  under  which  "counter-battery"  fire  is  to  be  preferred. 
Furthermore,  the  study  of  such  tactical  time-sequential  allocation  problems 
is  relevant  to  the  Navy  mission  of  fire  support  (both  by  ship  gunfire  and 
by  carrier-based  air) . 

In  Appendix  D  we  further  consider  the  determination  of  optimal  fire 
distribution  strategies  for  supporting  weapon  systems.   In  this  case  it  is 
appropriate  to  call  the  supporting  weapon  system  artillery.   We  consider 
extensions  of  some  recent  work  by  Kawara  [3]  concerning  optimal  strategies 
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for  supporting  weapon  systems  in  an  attack  scenario  which  is  a  variation  of 
a  model  considered  by  Weiss  [16].  We  first  examine  for  what  class  of 
criterion  functionals  (terminal  payoff  only)  the  optimal  fire-support 
strategies  are  independent  of  the  force  levels  and  then  examine  the  depend- 
ence of  the  optimal  fire-support  strategies  upon  the  form  of  the  combat 
attrition  model  by  considering  slightly  different  combat  dynamics  than 
those  considered  by  Kawara  [3]:   we  assume  that  the  attacker's  artillery 
produces  "linear-law"  attrition  (see  [11],  [14])  against  both  the  defender's 
artillery  as  well  as  infantry.   The  development  of  a  complete  solution  to 
the  latter  problem  has  involved  solution  phenomena  not  previously  encoun- 
tered in  a  Lanchester-type  differential  game:   the  dual  variables  are 
discontinuous  across  a  manifold  of  discontinuity  of  both  players'  strategies. 
The  research  reported  in  Appendix  D  was  undertaken  to  obtain  a  better 
understanding  of  the  dependence  of  the  structure  of  optimal  fire-support 
strategies  upon  model  form.   Previous  work  by  Weiss  [16]  (see  also  [2]) 
and  Kawara  [3]  had  given  the  impression  that  an  optimal  fire-support  strategy 
consists  in  always  concentrating  all  fire  on  one  enemy  target  type.   From 
our  previous  work  [11]  on  a  one-sided  Lanchester-type,  time-sequential  fire 
distribution  problem  in  which  each  of  two  enemy  target  types  undergoes  a 
"linear-law"  attrition  process,  we  knew  that  an  optimal  fire  distribution 
policy  could  consist  in  splitting  one's  fire  between  available  target  types. 
This  was  our  motivation  for  the  examination  of  other  attrition  structures 
in  Kawara' s  problem.   Additionally,  Kawara' s  recent  work  [3]  stimulated  our 
research  on  the  influence  of  combatant  objectives  on  optimal  fire-support 
strategies  because  of  Kawara' s  remarkable  result  that  (at  least  within  a 
certain  range  of  force  levels)  optimal  fire-support  strategies  do  not  depend 
on  force  levels.   We  were  able  to  show  that  Kawara  had  used  the  only  type  of 
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objective  function  that  yields  this  result.   Thus,  in  general,  the  result 
is  not  true. 

3.   Summary  of  Research  Findings  (same  as  in  [10]). 

Here  we  summarize  our  research  results.   We  have  (at  least  partially) 
accomplished  the  following  tasks  which  were  suggested  for  future  research 
in  our  previous  report  [9]:   (a),  (b2)  ,  (e)  ,  (g)  ,  (il)  ,  (j2),  and  (k)  . 
Results  are  organized  under  the  following  headings : 

(1)  solution  methodology  for  time-sequential  combat  games, 

(2)  insights  gained  into  the  optimization  of  combat  dynamics, 

(3)  implications  for  defense  planning. 

Items  (2)  and  (3)  differ  in  that  the  latter  is  a  management-oriented  digest 
of  the  practical  implications  of  our  research,  whereas  the  former  is  oriented 
towards  a  technical  audience.   Further  amplification  of  results  and  conclusions 
is  to  be  found  in  the  appendices. 

a.   Solution  Methodology  for  Time-Sequential  Combat  Games. 

Our  research  has  produced  the  following  results  on  solution  methodology 
for  time-sequential  combat  games.   Specifically,  we  have  accomplished  the 
following: 

(1)  developed  theory  of  state  variable  inequality  constraints 
for  Lan Chester- type  differential  games  (This  theory  is 
essential  for  all  problems  with,  for  example,  negativity 
restrictions  on  force  levels) , 

(2)  demonstrated  use  of  theory  of  state  variable  inequality 
constraints  for  solving  time-sequential  combat  games  by 
developing  solutions  to  several  specific  combat  optimiza- 
tion problems, 

(3)  developed  complete  solution  to  a  fire  support  differential 
game.   This  involved  the  following  technical  difficulties: 

(a)  singular  surfaces, 

(b)  discontinuity  in  the  dual  variables, 


(4)  developed  methodology  for  determining  the  functional  form 
of  the  criterion  functional  (terminal  payoff  here)  which 
yields  optimal  strategies  that  do  not  depend  on  force 
levels  (at  least  for  a  certain  range  of  force  levels) , 

(5)  concluded  that  computational  methods  must  give  consideration 
to  structural  properties  of  optimal  strategies  in  idealized 
versions  like  those  considered  in  this  report. 

b.   Insights  Gained  into  the  Optimization  of  Combat  Dynamics. 

Based  on  our  study  of  the  optimization  of  combat  dynamics  using  the 
mathematical  theory  of  differential  games,  we  have  reached  the  following 
conclusions: 

(1)  the  structure  of  optimal  strategies  depends  on  the 
following  factors: 

(a)  criterion  functional, 

(b)  combat  attrition  model, 

(c)  battle  termination  model; 

the  dependence  is  complex,  and  future  research  should 
concentrate  upon  the  examination  of  numerous  structures 
of  tactical  interest, 

(2)  optimal  fire-support  strategies  depend  on  the  nature  of 
the  attrition  process  produced  by  the  supporting  weapon 
system;  when  the  supporting  weapon  system  produces  casu- 
alties at  a  rate  proportional  to  the  product  of  the  numbers 
of  firers  and  targets  of  a  particular  type  (see  Appendix  D 
for  mathematical  formulation) ,  the  optimal  fire-support 
strategy  of  the  supporting  weapon  system  has  the  following 
characteristics : 

(a)  it  depends  on  the  optimal  strategy  for  the 
enemy's  supporting  weapon  system, 

(b)  the  optimal  distribution  of  supporting 
fires  may  be 

(i)   to  concentrate  on  enemy 

infantry, 
(ii)  to  split  fire  to  avoid 

overkilling, 
(ill)  to  concentrate  on  enemy 

artillery, 

(c)  counterbattery  fire  is  the  optimal  strategy 
during  the  early  stages  of  an  attack  and 
destruction  of  enemy  infantry  is  the  optimal 
strategy  during  the  final  moments  (unless  the 


ratio  of  defender  infantry  to  defender 
artillery  is  "extremely"  large,  in  which 
case  the  infantry  is  always  engaged) , 
(d)  a  split  of  supporting  fires  between  enemy 
infantry  and  artillery  as  an  optimal 
strategy  can  only  occur  when  enemy  infantry 
have  some  effectiveness  against  friendly 
infantry, 

(3)  optimal  air-war  strategies  are  different  for  the  case  in 

which  ground-war  objectives  are  considered  than  for  that  in 
which  they  are  not , 

(A)  optimal  air-war  strategies  (see  Appendix  B  for  scenario) 
depend  on  the  following  factors : 

(a)  residual  value  of  surviving  aircraft, 

(b)  force  levels  (especially  when  a  side  is 
going  to  lose  the  fight  for  air  supremacy: 
faced  with  a  future  loss  of  air  power,  one 
may  abandon  the  fight  for  air  supremacy 
and  get  what  ground  support  one  can  from 
his  planes  before  he  loses  them  all) , 

(5)  cases  with  variations  over  time  in  weapon  system  ef- 
fectiveness are  best  studied  as  extensions  of  constant 
coefficient  cases. 

c.   Implications  for  Defense  Planning. 

In  our  research  reported  here  we  have  studied  idealizations  of 

allocation  structures  that  commonly  occur  in  defense  planning  studies. 

After  studying  these  idealizations  in  order  to  gain  insight  into  the 

structure  of  optimal  strategies  in  the  complex  real-world  problem,  we  have 

reached  the  following  conclusions  as  to  considerations  that  should  be 

brought  to  the  attention  of  defense  planners.   These  results  should  be 

kept  in  mind  by  practitioners  who  perform  more  detailed  computer  simulation 

studies. 

(1)  The  combat  optimization  problem  should  be  thought  of  as 
consisting  of  three  parts: 

(i)    combatant  objectives, 

(ii)   conflict  termination  conditions, 

(iii)  combat  dynamics. 


Optimal  combat  strategies  depend  on  all  three  of  the 
above.   More  basic  scientific  research  should  be  done 
on  all  three,  especially  the  first  two. 

(2)  Force  levels  do  affect  (either  directly  or  indirectly) 
optimal  combat  strategies. 

(3)  It  may  be  quite  dangerous  to  generalize  optimal  combat 
strategies  developed  for  specific  problems.   At  present, 
more  research  is  needed  on  specific  problems  in  order  to 
develop  an  understanding  of  the  qualifications  that  may 
be  necessary  to  make  about  specific  study  results. 

(4)  Optimal  air-war  strategies  must  be  based  on  ground-war 
objectives.   Suboptimization  results  when  this  is  not 
done.   This  suboptimization  is  a  serious  problem,  since 
it  may  lead  to  winning  the  air  campaign  but  losing  the 
war. 


4.   Suggested  Future  Research  Tasks. 

After  performing  the  research  documented  in  this  report ,  we  feel  that 
the  current  state-of-the-art  for  applying  the  theory  of  differential  games 
to  time-sequential  combat  games  is  such  that  more  significant  results  may 
be  readily  obtained  in  the  future.  Moreover,  this  previous  research  pro- 
vides valuable  perspective  for  identifying  what  appear  to  be  the  most 
important  research  tasks  to  be  considered  next.   In  our  opinion  the  most 
important  task  is  to  examine  (and  then  understand)  the  influence  of  objec- 
tives on  optimal  strategies.   Another  important  task  is  to  study  the 
structure  of  optimal  fire-support  strategies. 

Based  on  our  past  research  experience  we  feel  that  there  is  much  to 

be  accomplished  in  the  future.   Specifically,  we  suggest  the  following  as 

future  research  tasks: 

(a)  Examination  of  the  effects  of  campaign  objectives  (as 
reflected  by  the  criterion  functional)  on  the  structure 
of  optimal  campaign  strategies.   In  all  our  past  research 
we  have  with  one  exception  always  considered  a  linear 
utility  for  survivors  in  the  criterion  functional.   It  is 
of  interest  to  examine  how  the  valuation  of  survivors 


affects  the  structure  of  optimal  strategies.   Other 
criterion  functionals  that  might  be  considered  are 

(1)  nonlinear  valuation  of  survivors 
(either  the  difference  or  ratio  of 
functions  which  are,  for  example, 
concave,  quasi-concave,  etc.). 

(2)  the  value  of  losses  rather  than 
survivors. 

It  would  seem  appropriate  to  begin  such  an  investigation 
by  considering  the  simplest  problem  possible. 

(b)  Further  general  study  of  optimal  fire-support  strategies. 
The  actual  military  operations  must  be  analyzed  and 
decisions  identified.   For  various  cases,  the  appropriate 
scenario  and,  consequently,  Lanchester-type  model  would 
be  developed,  and  the  optimization  problem  studied.   It 
is  felt  that  at  this  time  it  is  most  important  to  study 
various  specific  problems  in  order  to  gain  insight  into 
the  structure  of  optimal  fire-support  strategies. 

(c)  Further  study  of  optimal  fire-support  strategies  for  the 
model  given  by  equations  (64)  of  Appendix  D.   Some 
further  analytic  work  remains  to  be  done  on  the  fire- 
support  differential  game  model  considered  in  Appendix 
D.   It  remains  to  consider  the  effect  of  annihilation 

of   fire-support   resources  upon  optimal   time-sequential 
fire  distribution  strategies.      Additionally,   further 
computational  work  on   this   problem  would  be  worthwhile. 

(d)  Further  study  the  determination  of  optimal  air-war 
strategies  within  the  context  of  land-war  objectives. 
Based  on  preliminary  results  given  in  this  report,  it 
appears  as  though  the  outcome  of  the  ground  war  is  a 
significant  factor*  in  the  determination  of  optimal 
air-war  strategies  and  that  optimal  strategies  devel- 
oped for  a  model  not  considering  land-war  objectives 
need  not  be  optimal  for  a  model  which  does  consider 
them.   This  proposed  research  would  extend  the  results 
given  in  Appendix  C  of  the  report  at  hand. 

A  more  comprehensive  (although  somewhat  dated  now)  discussion  of 
suggested  future  research  tasks  can  also  be  found  on  pages  65-67  of  our  pre- 
vious report  [9]    (see  also  pp.  10-11  of  [10]).  Work  still  remains  to  be  done 
on  the  following  tasks  suggested  there:   (b) ,  (c) ,  (d) ,  (f) ,  (h) ,  and  (j). 


* 

This  is  not  considered,  for  example,  in  TAC  CONTENDER  [15]. 
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APPENDIX  C:   Optimal  Air-War  Strategies  Within  the  Context  of  Land-War 
Objectives 

I.   Introduction. 

As  discussed  in  Appendix  B,  an  important  problem  of  military  operations 
analysis  is  the  determination  of  optimal  air-war  strategies.   This  problem  is 
not  only  of  intrinsic  importance  but  also  its  solution  has  applications  to 
force  mix/force  structuring  analyses.   It  is  a  topic  of  current  interest 
[8]  and  has  been  for  over  thirty  years. 

In  Appendix  B  we  considered  a  differential  game  model  for  the  determin- 
ation of  optimal  strategies  for  the  employment  of  a  supporting  weapon  system 
(here  tactical  air  power)  which  we  called  the  tactical  air-war  game.   The 
constant  coefficient  version  of  this  model  may  be  stated  as 


maximize  minimize  {v  x(t_)  -  v  y(t-)  + 
U         V       X    t      Y    r 


(Bux-Avy)dt), 


with  stopping  rule:    tf  -  T  =  0 


subject  to: 
(air-battle  dynamics) 


—  =  r  -  (l-v)ay, 


dt 


s  -  (l-u)bx, 


(1) 


and 


where 


with  initial  conditions    x(t=0)  =  x   and   y(t=0)  =  y„ 


x,y  >  0         (State  Variable  Inequality  Constraints), 
0  <  u,v  <  1      (Strategic  Variable  Inequality  Constraints), 


x(t)   and   y(t)   are  the  numbers  of   X  and   Y   aircraft, 
respectively,  at  time   t, 

a   and  b   are  constant  (Lanchester)  attrition-rate  coefficients, 
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r  and  s   are  replacement  rates, 

v  (v  )   is  the  value  of  one  surviving   X(Y)   aircraft, 
X   i 

A(B)   is  the  (constant)  value  of  one   Y(X)   aircraft  flying 
ground  support  for  a  unit  of  time, 

u(v)   is  the  fraction  of  total   X(Y)   aircraft  which  fly  ground 
support  missions. 


A  further  discussion  of  the  formulation  of  this  model  is  to  be  found  in 
Appendix  B.   The  model  is  shown  diagrammatical ly  in  Figure  1. 


1-u 


Air 


x(t) 


Ai  r 


yd:) 


Figure  1.   Diagram  of  Tactical  Air-War  Game. 
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We  have  discussed  that  a  shortcoming  of  (1)  is  that  it  does  not  evaluate 
air-war  tactics  within  the  context  of  ground-war  objectives.   This  is  because 
the  objective  functional  (or  any  minor  variation  of  it)  does  not  directly 
reflect  the  outcome  of  the  land  war.   This  model  suboptimizes .   Assumptions 
have  been  made  which  result  in  a  very  mathematically  tractable  optimization 
problem,  but  one  which,  unfortunately,  does  not  consider  the  entire  system 
and  its  objectives.   We  will  now  consider  a  (still  idealized)  model  which  is 
considerably  broader  in  scope,  does  consider  land-war  objectives,  but  (unfor- 
tunately) is  considerably  less  susceptible  to  closed-form  analytic  solution. 
We  will  only  present  a  few  preliminary  results  with  further  study  left  as 
future  work. 

Let  us  consider  a  war  between  X  and  Y   forces,  each  of  which  is 
composed  of  both  ground  forces  (called  infantry)  and  air  forces.   The  ground 
forces  are  engaged  in  combat,  while  each  side  has  to  decide  the  optimal  use 
of  its  air  forces,  i.e.  how  to  optimally  allocate  these  resources  between  ground- 
support  missions  and  counter-air  missions  (see  Appendix  B  for  a  further  discus- 
sion) .   For  the  purposes  of  our  analysis  here,  let  us  assume  that  each  side 
wants  to  maximize  the  net  worth  of  survivors   at  the  end  of  a  war  which  ter- 

■k* 

minates  (for  the  sake  of  convenience)  with  the  annihilation  of  one  side  s 
or  the  other's  ground  forces.  Mathematically,  the  problem  may  be  stated  as 
the  following. 


* 
Further  considerations  for  the  determination  of  decision  criteria  are  discussed 

in  [3]  and  [4]. 

More  "realistic"  battle  termination  conditions  along  with  associated  analytic 
difficulties  are  discussed  in  [7]. 
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2  2 

maximize  minimize  {  £   v   x  (T)  -   £   v   y  (T) }   with   T   unspecified, 
U        V      k=l  \  k=l    k  " 


with  stopping  rule:        (a)    x  (T)  =  0, 


or 


(b)    Y](T)  =  0, 

dx.. 
subject  to:  -r— •  -  -a,,y,  -  va   y  ,  (2) 


(battle  dynamics) 


dt     "H'l    va12J2' 

dx 

--=  r2  -  (l-v)a22y2> 

dyl 

dT'=   "bllXl  "  Ub12x2' 

dy2 

ir =  S2  -  d-^^v 


with  initial  conditions 


x.(t=0)  =  x°   and  y. (t=0)  =  y°   for   i  =  1,2 


and 


x  ,x  ,y  ,y   ^0     (State  Variable  Inequality  Constraints), 
0  5.  u,v  ^  1     (Strategic  Variable  Inequality  Contsraints)  , 
where 

x  (t)  is  the  number  of  X  infantry  (i.e.  X..)  at  time  t, 
x_(t)  is  the  number  of  X  aircraft  (i.e.  X9)  at  time  t, 
similarly  for  y  (t)   and  y  (t), 

a..   is  a  constant  (Lanchester)  attrition-rate  coefficient  (the 

rate  at  which  one  Y.   unit  can  destroy  X.), 

J  i 

similarly  for  b.., 
i-J 

u(v)   is  the  fraction  of  total   X  (Y  )   forces  (i.e.  aricraft)  which 
fly  ground  support  missions, 

and  other  symbols  are  used  in  a  similar  fashion  as  those  for  probJem  (1). 

This  situation  is  shown  diagrammatically  in  Figure  2. 
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Air 
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Figure  2.   Model  for  Determination  of  Optimal  Air-War  Strategies 
Within  Context  of  Ground-War  Objectives. 


In  the  above  model  (2),  the  objective  of  each  side  is  to  "win"  the 
ground  war  as  "efficiently"  as  possible.   We  see  that  this  model  then  evalu- 
ates air-war  tactics  within  the  context  of  ground-war  objectives.   We  will 
develop  some  preliminary  results  for  the  determination  of  optimal  strategies 
for  (2).   Unfortunately,  it  is  a  very  hard  problem,  and  its  final  resolution 
may  require  making  some  simplifying  assumptions  or  using  computational  methods 
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Of  particular  importance  is  to  compare  optimal  strategies  for  (1)  with  those 
of  (2)  to  determine  the  effects  of  suboptimization.   It  is  of  great  interest 
to  determine  the  adequacy  of  air-war  strategies  which  have  been  developed 
in  a  model  like  (1)  by  evaluating  them  in  a  model  like  (2) .   For  reasons  of 
such  a  comparison,  we  have  included  replacements  of  both  sides'  aircraft  in 
(2).   It  should  finally  be  pointed  out  that  our  multiplier  conditions  for 
differential  games  with  state  variable  inequality  constraints  play  a  signifi- 
cant role  in  the  developments  of  this  appendix. 

■ 

2 .   Development  of  Basic  Necessary  Conditions  of  Optimality. 

It  should  be  clear  that  we  have  in  (2)  above  that   v   ,v   ^  0   for 

1     X 

i  =  1,2  and  that   r  ,s-,a   ,a   ,a2_,b.  ,b  „,b    >  0.   It  may  be  shown  using 
the  results  of  Friedman  that  the  differential  game  (2)  has  value  (see  pp.  210- 
230  of  [2])  and  that  a  saddle  point  exists  in  pure  strategies  (see  pp.  234-235 
of  [2]).   We  now  will  develop  necessary  conditions  of  optimality  for  (2). 

Applying  the  results  of  Appendix  A,  we  have  that  the  Hamiltonian  is 
given  by 

H(t>£,>y^E>a;'J>n'u>v)  =  Pl('~ailyl~val2y2)  +  P2^r2~<'1~V')a22y2* 

+  q1(-b]1x1-ub]L2x2)  +  q2{s2-(l-u)b22x2)  -  y(t)x2  +  n(t)y2>    (3) 


where 


u(t) 

and 

n(t) 


-  0    for  x  >  0 


:>  0   for  x  =  0, 


0   for  y2  >  0, 


£  0   for  y  =  0, 
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Because  of  the  stopping  rule  we  need  not  consider  the  state  variable  inequality 
constraints  (SVIC's)   x  ,y  >   0.   We  have  adopted  above  the  following  corre- 
spondence between  state  and  adjoint  variables: 

state  variable  dual  variable 

x.  p.   for  i  =  1,2, 

1  '  l 

y .  q .   for   i  =  1,2. 

It  is  also  convenient  to  define 

2  2 

$1(T,x(T),x,(T),o1)  =  I     vx  x.(T)  -  I     vy  y.(T)  +  o1x1(T),      (A) 

i=l    i  i=l    i 
and 

2  2 

*2(T,x(T),yjT),a2)  =  I      v^   x±(T)  -  J   vy  y.  (T)  +  a^  (T)  .      (5) 

i=l   i  "  i=l   i 

The  adjoint  system  of  differential  equations  for  the  dual  variables  is 

dPl      3R    ,  ^ 

dT  =  "  3x7 '"  ilV 

dp2     3H 

dT-  "  9^-  =  u*b12q3  +  (l-u*)b22q2  +  y,  (7) 

dT~=  "  8y7=  anpr  (8) 

dq2      8H 

IF  =  "  ^  =  V*a12Pl  +  (1-^)a22p2  '  n'  (9) 

The  boundary  conditions  at   t  =  T   for  the  adjoint  variables  will  be  discussed 
below. 

When   x9»y9  >   0)  the  extremal  strategic-variable  pair,  denoted  as 

(u*,v*),   is  determined  by  the  max-min  principle.   Hence,  we  consider 

maximize  minimize  H(t  ,x, £,£,0^,11=0  ,n=0  ,u,v)  ,  (10) 

0s>u£>l    O^v^l 


which  by  (3)  yields 


and 
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maximize  x2u^bi2^~ql  ^~b22^~q2^  * '  ^^ 

O^u^l 


minimize  y2(-v){a   p  -a22P2L  (12) 


Thus,  for  y   >  0,   we  have 

,  1   for  b12(-q1(t))  >  b22(-q2(t)), 
u*(t)  =  I  (13) 

'  0   for  b12(-qi(t))  <  b22(-q2(t)). 

It  may  be  shown  that  there  are  no  u-singular  subarcs  in  the  solution  of  (2). 
We  also  have  for  x„  >  0 

!1   for   a  p  (t)  >  a  p2(t), 
(14) 
0   for  a]2p1(t)  <  a22p  (t). 

It  may  be  shown  that  no  v-slngular  subarcs  exist. 


2.1.   Necessary  Conditions  of  Optimality  on  Constrained  Subarc  for   x . . 

X2        X2 
On  a  constrained  subarc  on  which   x„(t)  =  0   for   t   £.  t  £.  t.    the 

dx2  6  X2        X2 

strategic  variable   v*(t)   is  determined  by  - —  =  0   for   t   <  t  <  t. 

and  hence 

r2 
(1-v*)  = 


a22y2(t)  ' 


or 


r  XX 

v*(t)  " * "  W^  E°r   ^<l<  '*'  a5) 

dx2   X2  X2 

Since  we  must  have  0  ^>  v*  ^  1   and  - — (t   )  <  0   (here   t  '   denotes  a  left- 

dt   e  e 

hand  limit),  such  a  constrained  subarc  can  only  occur  when 

X         X 
r2  <  a22y2(t)   for  t&2   =-  t  *  t*.  (16) 
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x2  x2       X 

because   r   <  a  y  (t   ).   Since   x„(t)  =  0   for   t  "  ^  t  £  t.  ,   the  dimension 
e.  i.L   £.      e  Z  e  x. 

of  the  state  space  may  be  thought  of  as  being  reduced  by  one,  and  hence  the 

dimension  of  the  adjoint  variable  space  is  reduced  by  one  through  —  =  0. 

3v 


This  yields 


x2      x2 

a12P1(t)  =  a22p2(t)   for   tg   &  t  ^  t£  . 


(17) 


d   3H 
The  multiplier   u(t)   is  determined  by  -r— Or—)  =  0   and  hence 

at  dv 


y(t)  = 


22u 


a22{u*b12(-q1)+(l-u*)b22(-q2)}  -  a12bll(_ql) 


X2         X2 
for   t  "  <  t  <  t„  , 
e         I 


(18) 


■ 


Thus,  the  necessary  condition  of  optimality   u(t)  ^  0   leads  to  that  on  a  con- 
strained subarc  with   x„(t)  =  0   for  a  finite  interval  of  time  we  must  have 

X         X 
a22{u*b12(-qi)+(l-u*)b22(-q2)}  ^a12b11(-q1)   for  t*   <    t  <  t£2.   (19) 

x2      x2 

When  y   >  0   and  x  (t)  =  0   for   t  "  si  t  s.  t£  ,   we  have  that  v*(t)   is 

dx 
determined  by  the  condition  that  -: —  =0.   It  should  be  noted  that  (17) 

implies  that  (12)  is  identically  satisfied.   In  this  case  only  u*   is  to  be 
determined  by  the  max-min  principle  (10).   However,  when  x.(t)  =  0,   then 
the  max-min  principle  (or,  equivalently ,  (11))  no  longer  yields  that  we  must 
have   u*(t)   given  by  (13).   However,  we  may  still  take  (13)  to  hold  by  a  con- 
tinuity argument  in  which  we  consider   x?(t)  =  e    >     0   and  then  let   e  ->■  0 . 
Thus,  (13)  may  be  used  to  write  (19)  as 

x2      x2 

a22  maximum  (b^O-q^,   b22(-q2))  £  a  2b   (-q1 )   for   t£   <  t  <  t£  .    (20) 
It  remains  to  discuss  the  corner  conditions  which  must  hold  at  entrances 


to  and  exits  from  constrained  subarcs  on  which   x.(t)  =  0   for  a  finite  interval 

X2        X2 
of  time.   At  entrance  to  constrained  subarc  with   x  (t)  =  0   for   t   s>  t  ^  t 

Z  G  A/ 

(see  Figure  3  below),  we  must  have 


C-10 

+ 

XXX 
Pl(te2)    =   "i(Ce2>    '   "iO      f°r      1  "    l'2' 

+ 

XXX 

qi(te2)  =  qi(te2)  =  qi(te2)    for   i  =  1»2,  (21) 

X  X 

H(t/)    =   H(t/), 
e  e 

X~  XXX  X  X~  X 

where      H(t   2)      denotes     H(t   2,x..  (t    2)  ,x„  (t   2)    =  0,      X.(t   2),g.(t   2),fl,(t    2), 
e  ele/e  *-     e        *^     e        ~     e 

0  9 

y=0,n=0,u*(t   ),v*(t   )  =  1).   It  is  readily  seen  that 

X  X  X  X  X 

H(te2)    -   P^t/x-^^t.2))   +  p2(te2){r2-a22y2(te2)) 

XXX 
-qx(te2)bux   (te2)   +  q2(te2)s2, 


and    that 


XXX  XX 

H(te2)   -  P^t/M-a^Ct/)    -    (l-r2/(a22y2(te2)))a12y2(te2)} 


-ql<t:e2)bllXl(te2>   +  q2(Ce2)s2- 

X  X  X  XX  X        a 

so    that     H(t   2)   =  H(t   2)    »p,(t   2){r  -a.0y.(t   2)}   =   p.  (t   2)  {r0-a_0y_  (t   2) } 


whence 


X  X 

3l2Pl(te2)    -a22P2(te2)>  (22) 

X2, 
since  we  must  have      r      <   a   9y.(t      ).      We   thus   see   that    the   corner   conditions 

(21)    are   automatically   satisfied  when    (15)    through    (19)    hold,    and    thus    they 

yield  no  new   information. 
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x  =0 


2  w  77 


tuuew  t 


/  !    t  I   i 


1-0 


Figure  3.   Entry  to  and  Exit  from  Constrained  Subarc. 

x2      x2 

At  exit  from  constrained  subarc  with  x_(t)  =  t   £  t  ^  t»  ,  we  must 


have 


+ 


X         X         X 
Pi(t£  }  =  Pi(t£  }  =  Pi(t£  }   for  ±   =   1»2' 


XXX 
qi(t/}    =   qi(t/}    '   qi(t/}      f°r      *    =   L>2' 


(23) 


X  X 

H(t/}    =   H(t£    } 


It   is   readily  seen   that 


x«  x_  x„ 

H(t*  >  •  Pi<H  H-a^lt, 2) 


-     1  - 


x2  J 
a22y2(tji  ) 


X2 
a12y2(t£  )} 


X_  X_  X- 

"ql(t£    )bllXl(t£    >   +q2(t*    )S2' 
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and  that 

+ 
X         X  X  X  X 

H(tt2)  =  PiC/K-a^a/l-a^ft,2)}  +  P2(t,2)r2 

XXX 
-qi(t£2)bllXl(t£2)  ♦  q2(t,2)s2, 

X~      x+ 

so  that  HCt^2)  =  H(tA2)  » 

x2        x2 

a12Pl  <-t£  *  =  a22P2^£  *'  ^24^ 

Again,  we  see  that  the  corner  conditions  (23)  are  automatically  satisfied  when 
(15)  through  (19)  hold,  and  thus  they  yield  no  new  information. 

2.2.   Necessary  Conditions  of  Optimality  on  Constrained  Subarc  for   y  . 

Similar  analysis  yields  for  a  constrained  subarc  on  which  y9(t)  =  0 

Y         Y 
2         2 

for  t  s;  t  s  t„    that  we  must  have 
e       a 

s  Y         Y 

u*(t)  = * "  W^  £or  ^2<t<  t%2,  (25> 

2         2 
with  s_  <  b-_x9(t)   for   t   £  t  ^  t«  .   Additionally,  we  must  have 

Y         Y 

b12("ql(t))  =  b22("q2(t))   f°r  te      *  t   &  tli  (26) 

and 

Y         Y 

n(t)   =  b27[b22{v"a12Pl+(1-V*)a22P2}-b12allPl]    *°      f°r      **      *    l   *    «=*   '  (2? 

The  latter  condition  may  also  be  written  as 

Y  Y 
b22{v*a12Pl+(1_V*)a22P2}  *  b12allPl   f°r  te      <  t  <  ^l*         (28) 

or  by  use  of  (14)  (which  was  developed  from  (12)  for  y~  >  0) 

Y  Y 
2         2 

b22  maximum  (a12Pl ,a22P2^  *  b12allPl   f°r   te   <  t  <   tH    '    ^29^ 
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The  corner  conditions  yield  that  at  entry  to  constrained  subarc  on 

2         2 
which   y0(t)  =  0   for   t    £•  t  ^  t0  ,   we  must  have 

Z  G.  X* 

Y~        Y         Y 
Pi(te2)  =  Pi(te2)  =  Pi(te2)   f°r   i  =  1,2> 

+ 

Y  Y         Y 

qi(te2)  =  qi(te2)  =  qi(te2)   f°r   1  =  1,2»  (30) 

b12(-qi(te2))  =b22(-q2(te2)). 

Also,  the  corner  conditions  yield  that  at  exit  from  constrained  subarc  on 

Y         Y 
2         2 
which  y0(t)  =  0   for   t   £  t  £  t»  ,  we  must  have 

Pi(t£2)  =  Pi(t£2>  =  Pi(t£2>   for  ±   =  X'2' 

+ 

Y  Y         Y 

qd(t£2)  =  q±(ti2)    =   qi(t£2)   f°r   i  =  1'2'  (31) 

b^C-q.Ct,2))  =b22(-q2(t£2)). 

Thus,  the  corner  conditions  yield  no  useful  information  that  we  did  not 
already  know. 


2.3.   Boundary  Conditions  for  Adjoint  Variables. 
There  are  two  cases  to  be  considered: 

(1)  x2(T)  =  0, 

(2)  Yl(T)  =  0. 

Case  (1):   x  (T)  =  0 . 

In  this  case  we  use  the  function   4>    defined  by  (4)  in  the  transver- 
sality  conditions.   It  should  also  be  clear  that  we  must  have   y  (t=T)  >  0. 
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The  boundary  conditions  at   t  =  T  for  the  adjoint  variables  are  then 


Pl(t=T)  =  vXi+o1 


where  a   is  an  unrestricted  multiplier,    (32) 


P2(t=T)  -  v^  -  vx 


=  0   for  x  (T)  >  0, 
where   v,  <  (33) 


•A 


£  0   for   x  (T)  =  0, 


q](t=T)  =  -vy 


(3A) 


q2(t=T)  =-vY2+v2 


where 


M 


=  0   for   y2(T)  >  0, 
^  0   for   y2(T)  =  0. 


(35) 


We  may  also  write  (32)  as 


P1(t=T)  =  a 


where  a  is  an  unrestricted  multiplier.    (36) 

3*. 


We  determine  a   from  the  transversality  condition  H(T)  +  -r^—  =0,   or 


H(T,xjT),yjT),pjT),qjT),y,n,u*(T),v*(T))  =  0, 


(37) 


Using  (3),  we  then  have 


(-a){a1]yi(T)  +  v*(T)a12y2(T)}  +  (vx  -v1){r2-(l-v*(T))a22y2(T) } 


or 


a   - 


+  vy  u*(T)b12x2(T)  -  (vy  -v2){s2-(l-u*(T))b22x2(T)}  =  0, 

(VX  -V{r2~(1~V*(T))a22y2(T)}+VY  u*(T)b12x2(T)"(vY  -v2)(s2-(l-u*(T))b22x2(T)} 

{aliyi(T)  +  v*(T)a12y2(T)} 


If  the  system  is  on  a  constrained  subarc  with   x  (t)  =  0   for   t  "  si  t  SJ  T 

x2 

with   t   <  T,   then  it  is  clear  that  we  must  have  y?(T)  >  0   so  that  ^     =  0. 
Thus,  the  boundary  conditions  (33)  through  (36)  for  the  adjoint  variables  take 
the  form 
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Pl(t=T)  =  ot 


P2(t=T)  =  vx  -  \>1     where   v   £  0, 

q  (t=T)  -  -v   , 
1 

q2(t=T)  =  -vy  . 


where  a   is  an  unrestricted  multiplier,     (39) 

(40) 
(41) 
(42) 


Since  we  have  been  on  a  constrained  subarc  with  x  (t)  =  0   for  a  finite 

interval  of  time,   Y  must  be  using  the  control  (15)  with   r   <  a  y  (t) 

X2 

for   t  ^  t  ^  T,   and,  in  particular, 


r2  <  a22y2(T) 


(43) 


We  also  must  have  by  (17) 


a12P] (t^T)  =  a22P2(t=T) 


(44) 


Combining  (39),  (40),  and  (44),  we  obtain 


a12a  =  a22(vX2-V' 


where   v   must  satisfy  v1  ^  0  and  thus 


(45) 


Vl   =   a^   (a22VX2-a12°°    ^°' 


(46) 


Recalling  that   x„(T)  =  0  and  substituting  (45)  into  (38),  we  obtain 


VY2S2 


a   r 

(anVT)  +  r 


22L 


a22y2(T)-r2 


(47) 


so  that  by  (43)  we  have   a  <  0.   It  should  be  noted  that  (46)  is  automatically 
satisfied  with   v   >  0.   We  also  have 


12 
p9(t=T)  =  —  a  <  0 

1  a22 


(48) 
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Thus,  we  have  proved 


THEOREM  1: 

If  the  system  is  on  a  constrained  subarc  with   x_(t)  : 

X                 X 

for   t   £  t  ^  T  with   t  '  <  T,   then  we  must  have 
e                 e 

=  0 

(a) 

r2 
y0(T)  >  - —  >  0    (so  that   q.(T)  =  -vy  ) , 
2.              a22                l                  *2 

(b) 

a  <  0   given  by  (47) . 

3W 


Recalling  that  a  =   p^T)  =  ^  (T) 


where  W  =  W(t ,x- ,x  ,y  ,y  )   denotes 


Bellman's  optimal  value  function  [1],  we  see  that  there  is  a  negative  marginal 
return  to  X  for  having  more  infantry.   This  is  understandable,  since  if  he 
did  have  more   X..   forces  (but  still  lost  the  ground  war)  ,  the  war  would  be 

prolonged  to  the  advantage  of  Y  who  has  complete  air  superiority. 

Y2 
If  the  system  is  on  a  constrained  subarc  with  y9(t)  =  0   for   t   ^ 

Y 

t  *»  T  with   t   <  T,   then  it  is  clear  that  we  must  have  x  (T)  >  0   so 

that   v..  =  0.   Thus,  the  boundary  conditions  (33)  through  (36)  for  the  adjoint 

variables  take  the  form 

p1 (t=T)  =  a  where  a   is  an  unrestricted  multiplier,  (49) 


P2(t=T)  =  v^, 

q  (t=T)  =  -v   , 
1 

q2(t=T)  =  -vy  +  v2   where   v2  £  0. 


(50) 
(51) 
(52) 


Since  we  have  been  on  a  constrained  subarc  with  y„(t)  =  0   for  a  finite 
interval  of  time,   X  must  be  using  the  control  (25),  and,  in  particular, 
at   t  =  T  we  have 


u*(t=T)  =  1  - 


b22x2(T)  • 


(53) 
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We  also  must  have  by  (26) 


b12(-q1(t=T))  =  b22(-q2(t=T)) 


Combining  (51),  (52),  and  (54),  we  obtain  then 


(54) 


V2  =b^  (b22VY2-b12VY1)  *°" 
Recalling  that  y~(T)  =  0  and  substituting  (53)  into  (38),  we  obtain 

b. 


(55) 


v„  r„  + 


12 


a  = 


X^2   b22  VY1{b22X2(T)  "  S2} 


(56) 


where  we  must  have   s~  <  b   x  (T)   so  that   a  >  0.   Thus,  we  have  proved 


THEOREM  2: 

If  the  system  is  on  a  constrained  subarc  with  y9(t) 

Y                 Y 
2                  2 
for   t   &  t  ^  T  with   t  "  <  T,   then  we  must  have 
e                 e 

=  0 

(a) 

s2 
x.(T)  >   *  >  0    (so  that  p_(T)  =  vv  ), 

1              b22                 l                 X2 

(b) 

b22VY2  fe  b12VY1' 

(c) 

a  >  0   given  by  (56) . 

Case  (2):   y1(T)  =  0. 

This  case  is  similar  to  the  previous  one  only  with  the  roles  of   X 
and  Y  interchanged. 


3.   Introduction  of  the  Switching  Functions   S  (t)   and   S  (t)  . 

It  is  convenient  to  consider  the  switching  function   S  (t)   defined  by 

a u 


Su(t)  =  b12(-qx(t))  -  b22(-q2(t)). 


(57) 
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Then,  we  may  re-write  the  extremal  control  law  (13)  for  the  strategic  variable 
u ( t )   as 


for  y2  >  0 


/  1   for   S  (t)  >  0, 
u*(t)  =  |  (58) 

*  0   for   S  (t)  <  0, 

and  it  follows  from  (57)  and  the  adjoint  equations  that 

for  y  >  0: 

dS    (  Pl(b22al2-b12all)  f0r   V*  =  l' 

-^  ■  (59) 


dt 


and 

dS 


b22a]2P2-b12allPl  ^Pl(b22a12-b12all)   f°r  V*  =  ° ' 


— --  =  0  when  y0  =  0   for  a  finite  interval  of  time.       (60) 
at  l 

Similarly,  it  is  convenient  to  consider  the  switching  function   S  (t) 


defined  by 


Sv(t)  =  a12Pl(t)  "  a22P2(t)*  (61) 


Then,  we  may  re-write  the  extremal  control  law  (14)  for  the  strategic 
variable  v(t)   as 

for  x  >  0: 

{1   for   S  (t)  >  0, 
(62) 
0   for   S  (t)  <  0, 

and  it  follows  from  (61)  and  the  adjoint  equations  that 
for  x   >  0: 
dS     (  (_qi)(a22b12"al2bll)  for  u*  =  l- 

dT  -  (63) 

U22b22(-q2)-a12bn(-qi)  ^  (-q1)(a22b12-a12b11)   for  u*  =  0, 
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and 


dS 

- —  =  0  when  x_  =  0   for  a  finite  interval  of  time.    (64) 
at  z 


4 .   Synthesis  of  Extremal  Strategic-Variable  Pair. 

In  this  section  we  will  partially  synthesize  the  extremal  strategies 
in  one  of  four  cases.   We  hope  to  study  this  important  problem  more  thoroughly 
in  the  future.   There  are  four  cases  to  be  considered: 

(I)   b22a12  >  b12an 

(1)  a22b12  >   a12bn 

(2)  a22bl2  *  a12bn 


(II)      b22a12.sb12an 

(1)  a22b12  >   a12bn 

(2)  a22b12  s  a12bu 


Comments 


(A)  The  quantity  b   a  „  may  be  considered  as  the  rate  of  destruction 
by  X?  of  Y's  kill  capability  against   X    (see  also  [5],  [7]). 

(B)  The  quantity  b  _a    may  be  considered  as  the  rate  of  destruction 
by  X?   of  Y-i's  kill  capability  against   X  . 

Case  (II):   b22g_12_>^12a11__^nd__a22b12_2^,12b11 . 

Let  us  first  make  some  observations  before  we  give  a  few  preliminary 


results.   For  y   >  0   and  p,  (t)  >  0  by  (59)  we  have 


dS     .  p 
u  _  j   1 


p,  (b22a12-b12al;L)  >  0   for  v*  =  1 , 


b22a12P2  "  b12allPl  ^Pl(b22a12-b12ail)  "  °   f°r  V*  =  °' 


so  that 
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dS 

--(t)  >  0   for   y_  >  0   and   p.  (t)  >  0 
at  z  L 


(65) 


In  a  similar  fashion  it  may  be  shown  that 

dS 


— -(t)  >  0   for  x  >  0  and  q  (t)  <  0. 


(66) 


Since  we  will  synthesize  extremals  to  (2)  by  working  backwards  from  the  end 
at   t  =  T,   it  is  convenient  to  introduce  the  backwards  time   T   defined  by 


t  =  T  -  t. 

dS      dS 
It  readily  follows  that  -j—  =  -  - —  .   Thus,  we  may  re-state  the  above 

results  (65)  and  (66)  as  follows: 


(67) 


Also, 


dS 

PROPOSITION  2:   If   x  >  0   and  q.  (t)  <  0,   then  ~ 

2  Hlv      '        dx 


<  0 


Also,  let  us  make  some  observations  about  the  satisfaction  of  necessary 

conditions  of  optimality  for  a  constrained  subarc  on  which  x~(t)  =  0   for 

X«        X_         X_    X_ 
t   £  t'£  t0   with   t   <  t.  .   Our  assumption  that   a  b    >  a  ~b    implies 

that  for  qx(t)  <  0  we  have   (_(l]_)a22b12  >  ^~ql^a12bll'   Thus '  if  b12^~qi^ 
^b22(-q2),   then  it  follows  that  a22b22^~q2^  ^  a22b12^~ql^  >  a12bll^~ql^ ' 
By  the  above,  it  follows  that  the  two  conditions   a__b19  >  a  „b    and  q,  (t) 
<  0   imply  that 

a22  maximum  (b^C-q^  ,b22(-q2))  >  ai2bll^~ql^' 


Thus,  we  have  proven 
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PROPOSITION  3: 

If   q1(t)  <  0   and   a  b    >  a12bll'   then  the 

necessary  condition  of  optimality  (20)  for  being 

on  a  constrained  subarc  with   x_(t)  =  0   for 

X         X          X     X 

t   st  it.   with   t   <  t„    is  satisfied, 
e         I                       e     £ 

The  significance  of  the  above  proposition  is  that  it  guarantees  that  (local) 
necessary  conditions  of  optimality  are  automatically  satisfied  whenever  the 
system  is  steered  to  x„  =  0  and  maintained  that  way  for  a  finite  interval 
of  time.   Similarly,  we  can  prove 


PROPOSITION  4: 

If  p1(t)  >  0   and   D22ai?  >  b12ai1'   then  the 

necessary  condition  of  optimality  (29)  for  being 

on  a  constrained  subarc  with  y~(t)  =  0   for 

Y      .   Y          Y     Y 
2         2          2     2 
t   £  t  £  tn   with   t  '  <  t„    is  satisfied, 
e         Jc          ex, 

Considering  the  above  results  it  seems  appropriate  to  examine  under 
what  conditions   P-,  (t)  <  0  and  q,  (t)  >  0.   From  an  integration  of  the  adjoint 
equations  (6)  and  (8),  we  have  that  for  0  ^  t  £  T 


11 


P1(t)  -  p1(t=T)cosh/a11b1.  (T-t)    J -—   q  (t=T)sinh/a  bn  (T-t),   (68) 


and 


qx(t)    =   q1(t-T)cosh/a11b11    (T-t)    -    j  ^ 


11 
11 


P1(t=T)sinh/a11b11    (T-t).      (69) 


Thus,  we  can  state  the  following  self-evident  propositions 


PROPOSITION  5:   If  p,(t=T)  >  0  and  q;,(t=T)  <  0,   then 


and 


Px(t)  >  0 
q1(t)  <  0 


for  all   t  fc  [0,T]. 


Also, 
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PROPOSITION  6 


and 


If  p  (t=T)  ^0   and  q-U-T)  <  0   (or, 
equivalently,   p  (t=T)  >  0   and   q  (t=T)^0), 
then 


Pj_(t)  >  0 
qx(t)  <  0 


for  all   t  £  [0,T). 


Let  us  now  consider  the  case  in  which  Y  wins ,   i.e.   x..  (T)  =  0. 
There  are  two  further  subcases  to  be  considered: 

(a)  y2(t=T)  >  0, 

(b)  y2(t=T)  =  0. 

In  Subcase  (a):   y9(T)  >  0,   the  boundary  conditions  (33)  through  (36) 
for  the  adjoint  variables  become 


Px(t=T)  =  a 


where  a   is  an  unrestricted  multiplier, 


=  0   for  x2(T)  >  0, 


p  (t=T)  =  v   -  v   where  v  \ 
Z         A2    X  *  ^  0   for  x  (T)  -  0, 

qx(t=T)  =  -vy  , 


q2(t=T)  =  -vy 


(70) 

(71) 

(72) 
(73) 


Let  us  further  assume  that   a10vv  >  aoovv  an<^  that  b   v   >  b   v   .   If 

x  (T)  >  0,   then  the  assumption  that  b   v  >  b  v   ,   (57),  (72),  and  (73) 

yield  that   S  (t=0)  >  0   so  that  by  (58)  we  have  u*(t=0)  =  1.   The  trans- 
versality  condition  (37)  then  yields  that 


P1(t=T)  = 


vX2{r2-(l-v*(T))a22y2(T)}  +  v^b^d)  -  vy2S2 
<a11y1(T)  +  v*(T)a12y2(T)} 


(74) 
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If  we  consider  the  case  in  which  a  p  (t=T)  ^  a0Ovv   where  p  (t=T)   is 

given  by  (74),  then   S  (t=0)  £  0  with  q  (t=T)  <  0   implies  that   S  (t)  <  0 

for  0  <  x  <  x  ,   since  then  q,  (x)  <  0   for  0  s  x  <  x   so  that  by  Proposi- 

dS   V  Q 

tion  2  -j-^(x)  <  0   for  0  ^  x  <  x   <  t  .   Also,  if  p  (t=T)  £  0,   then  by 

Proposition  6  we  have  p,(t)  >  0   and  q  (t)  <  0   for  all   t  C  [0,T).   Then 

Proposition  2  yields  that   S  (x)  <  0   for  0  <  x  £>  T,   since   S  (x=0)  ^  0 

dS  V  V 

and  -t~^(t)    <   0   for  0  s  x  £  T.   Thus,  if  0  &  a   p  (t=T)  £  a  v   ,   then 

O.T  J.A    _L  Z. Z.    X_ 

v*(t)  =  0   for  0  £  t  ^  T.   Furthermore,  since  p  (t)  >  0,   we  have   S  (x=0) 
dS  1  u 

>  0  with  - — (x)  <  0   for  all  x  ^  0.   Hence,  the  equation   S  (x=x1)  =  0 
ax  u    1 

has  a  solution,  and  there  is  a  switch  in  X's   extremal  strategy  at  x  =  x 
in  backwards  time.   To  summarize,  we  have  shown  that  for 


x  (t-T)  =  0,    x2(t=T)  >  0,   yi(t=T)  >  0,  y2(t=T)  >  0, 
and 

0.*a12Pl(t=T)  *a22VX2   and  b12VY;L  "  b22VY2' 

in  backwards  time  the  extremal  strategic-variable  pair  is  given  by 


! 


u*(x)  =  1 
v*(x)  =  0 


and 

u*(x)  =  0 


*v*(x)  =  0 


for    0  £>  x  ^  t, 
1 


for   x   <  x  ^  T. 


Unfortunately,  much  more  work  remains  to  be  done. 

In  Subcase  (b);   y9(T)  =  0,   let  us  briefly  consider  the  further  subcase 

Y  Y 

2  2 

in  which  y.(t)  -  0   for   t  ^  t  2»  T  with   t  "  <  T.   Then  by  Theorem  2  we 
z               e  e 

must  have 

s2 
x9(T)  >  rf-  >   0,  (75) 

2      b 


iind 
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b22VY2   *bl2\>  (76) 

P](t=T)    =  a   >    0,  (77) 

s  Y 

U*(T)  =  1.__     for     0ST<Te    .  (78) 

By    (31)   and    (5  7),   we   have 

Y2 
S    (t=t    Z)    =  0.  (79) 

u         e 

Now  (77)  and  q  (t=T)  =  -vy  <  0   imply  by  Proposition  5  that   p  (t)  >  0 

1 
and  q,  (t)  <  0   for  all   t  £  [0,T].   We  then  have  by  Proposition  1  that 

dS 

T^CO  <  0   for  all   x  €  [0,T].  (80) 

The  conditions  (79)  and  (80)  yield  that 

S  (x)  <  0   for  all  x    €  (tY,T],  (81) 

so    that  by    (58)   we  have 

Y2 
u*(t)    =  0      for  all      t    k   (t      ,T]. 

e 

It  should  be  noted  that  by  Proposition  4  the  necessary  condition  (29)  is 
satisfied  on  the  constrained  subarc.   Thus,  we  see  that  this  subcase  can  only 
arise  when  (76)  holds  and  then 

Y2 
,0  for  0  *  t.*  T  -  t  , 

U*(0  =  =2  \ 

1  1  - V~T   for  T-x<t*T. 

b22x2(t) 

Again,  we  must  terminate  our  discussion  with  this  preliminary  result. 
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5 .   Discussion. 

In  this  appendix  we  have  applied  the  theory  of  differential  games 
(including  the  theory  of  state  variable  inequality  constraints  (SVIC's) 
developed  in  Appendix  A)  to  the  study  of  optimal  air-war  strategies  in  a 
model  which  considers  ground-war  objectives.   Our  reasons  for  doing  this  have 
been  explained  in  the  introduction  to  this  appendix.   The  results  presented 
in  this  appendix  are  preliminary,  being  based  on  an  initial  examination.   We 
feel  that  this  is  an  important  and  promising  area  and  propose  such  further 
work  to  ONR  as  a  future  research  task.   The  complete  determination  of  optimal 
strategies  for  (2)  will  be  an  involved  task  and  must  follow  the  solution 
methodology  given  in  [6]. 

It  should  be  pointed  out  that  the  model  (2)  may  be  thought  of  as  a 
generalization  of  the  supporting  weapon  system  game  of  H.  K.  Weiss  [9]  (see 
also  [6]).   The  model  (2)  reduces  to  this  simpler  case  when  r  =  s   =  0, 

ail  =  bll  =  °'   al2  =  a22  =  b12  =  b22  =  I'  VX±  =  \  =   l>      and  VX2  =  %  =  °' 
It  should  be  noted  that  this  corresponds  to  Case  (II)  above.   Thus,  study  of 

the  model  (2)  with  r  =  s?  =  0  and  a   =  b   =  0   is  itself  of  considerable 
intrinsic  interest,  since  it  generalizes  the  results  of  Weiss  [9]  (see  also 
[6]).   It  should  be  pointed  out  that  the  theory  of  SVIC's  has  never  been  used 
before  to  study  such  a  problem. 

From  our  preliminary  results  (which  have  been  a  characterization  of  an 
optimal  strategy  but  not  the  actual  determination  of  one)  ,  it  appears  as 
though  the  outcome  of  the  ground  war  is  a  significant  factor  in  the  determina- 
tion of  optimal  air-war  strategies  and  that  optimal  strategies  developed  for 
the  model  (1)  need  not  be  optimal  for  the  model  (2).   It  would  be  of  great 
interest  to  numerically  compare  the  payoff  to,  for  example,   X  from  using  an 
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optimal  strategy  for  the  model  (1)  in  (2)  with  that  from  using  the  optimal 
strategy  for  (2).   The  sensitivity  of  the  payoff  to  X's   strategy  is  of 
particular  importance.   Thus,  we  propose  to  ONR  to  further  study  the  model 
(2)  and  to  compare  results  with  (1) . 

Our  initial  investigation  here  has  produced  an  insight  of  particular 
importance  for  force-level  planning.   By  Theorem  1  we  see  that  increasing 
the  X   force  level  (or  the  X»   force  level)  late  in  the  war  may  actually 
decrease  the  payoff  to  X   (even  if  he  follows  an  optimal  strategy)  if  the 
system  still  reaches  the  end  state  of  x1 (t=T)  =  0   and  x9(t-T)  =  0,   since 
the  war  is  prolonged  in  a  losing  cause  to  the  profit  of  Y.   Such  phenomena 
should  be  examined  more  thoroughly  in  the  future.   This  may  be  the  most 
significant  insight  developed  from  our  research.   Intuitively,  as  was  possibly 
the  case  in  the  war  in  Vietnam,  if  a  side  commits  resources  that  are  not 
sufficient  to  produce  a  favorable  outcome  in  a  time-sequential  combat  game 
but  only  enough  to  prolong  the  occurrence  of  an  unfavorable  outcome,  then 
there  may  be  negative  marginal  return  from  the  resources,  and  it  is  foolish 
to  use  them  accordingly. 
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APPENDIX  D:   Some  Differential  Game  Models  for  the  Study  of  Optimal  Fire- 
Support  Strategies. 

1.   Introduction. 

The  determination  of  optimal  fire  distribution  strategies  for  supporting 
weapon  systems   is  a  major  problem  of  military  operations  research.   This 
problem  in  one  form  or  another  is  probably  one  of  the  most  extensively  studied 
problems  in  both  the  open  literature  and  also  classified  sources,  although 
this  observation  apparently  has  not  been  made  previously.   The  problem  is  of 
interest  to  the  military  tactician  so  that  he  may  have  a  clearer  understanding 
of  the  circumstances  under  which  enemy  infantry  should  be  engaged  by  a  support- 
ing weapon  system  (such  as  artillery)  and  those  under  which  "counter-battery" 
fire  is  to  be  preferred.   Furthermore,  the  study  of  this  tactical  allocation 
problem  is  relevant  to  the  Navy  mission  of  fire  support  (both  by  ship  gunfire 
and  by  carrier-based  air) .   Related  optimization  problems  (in  which  the  support- 
ing weapon  system  is  called  "air")  have  been  considered  in  the  previous 
appendices. 

As  we  have  noted  before,  Berkovitz  and  Dresher  [3]  make  the  point  with 
which  we  agree  that   operational  gaming   is  not  a  helpful  device  for  solving 
a  game  or  getting  significant  information  about  the  solution."  One  must  dis- 
tinguish between  finding  out  how  people  make  decisions  and  how  they  should. 
Most  analysts  agree  that  operational  gaming  is  not  a  useful  tool  for  answering 
the  latter  question.   As  Weiss  has  also  emphasized  [32],  a  model  of  an  idealized 
combat  situation  is  particularly  valuable  when  it  leads  to  a  clearer  understand- 
ing of  significant  relationships  which  would  tend  to  be  obscured  in  a  more 


See  [32]  for  a  brief  discussion  of  the  distinction  between  a  "primary"  weapon 
system  (or  infantry)  and  a  "supporting"  weapon  system. 

See  [21]  or  [29]  for  a  discussion  of  terminology  and  background. 
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complex  (and  "realistic")  model.   It  is  in  this  spirit  that  most  of  the  work 
reviewed  below  has  been  done  and  in  which  we  consider  several  simplified 
models  for  gaining  insight  into  optimal  fire  support  strategies. 

It  seems  appropriate  to  briefly  sketch  some  of  the  work  previously  done 
on  such  problems  and  how  our  work  here  is  related  to  this.   The  problem  of 
the  appropriate  mixture  of  tactical  and  strategic  forces  (another  aspect  of 
the  optimal  fire  support  strategy  problem)  was  extensively  debated  by  experts 
during  World  War  II.   Some  analysis  details  may  be  found  in  the  classical 
book  by  Morse  and  Kimball  (see  pp.  73-77  of  [20]).   The  problem  was  studied 
at  RAND  in  the  late  1940' s  and  early  1950's  (see  [12])  and  elsewhere  (see  [1]). 
It  would  probably  not  be  too  far-fetched  to  claim  that  this  problem  stimulated 
early  research  on  both  dynamic  programming  (see  [2])  and  also  differential 
games  (see  [12],  [14]).   Today  the  problem  of  optimal  air-war  strategies  is 
being  extensively  studied  by  a  number  of  organizations  (see,  for  example,  [19], 
[23],  [30]). 

In  Appendix  B  we  have  considered  a  differential  game  model  closely 
related  to  A.  Mengel's  "War  of  Attrition  and  Attack"  (see  pp.  96-105  of  Isaacs' 
book  [15]).   Discrete-time  versions  of  this  problem  for  the  determination  of 
optimal  "air-war"  strategies  (see  also  [12])  have  been  considered  by  a  number 
of  workers  as  time-sequential  combat  games  [3],  [4],  [11]  (see  also  [5],  [8]). 
Another  related  problem  was  considered  by  Weiss  [32],  who  studied  the  optimal 
selection  of  targets  for  engagement  by  a  supporting  weapon  system.    Recently, 
Kawara  [16]  has  studied  optimal  strategies  for  supporting  weapon  systems  in 
an  attack  scenario  which  is  a  variation  of  the  model  considered  by  Weiss  [32]. 


See  [28],  however,  for  a  justification  of  the  optimality  of  strategies  determined 
by  Weiss  [32].   A  general  solution  algorithm  is  also  presented  in  this  paper  [28], 
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Other  recent  work  has  considered  various  conceptual  and  computational  aspects 
of  time-sequential  combat  games  [22],  [23],  [24]. 

Since  our  work  here  may  be  considered  to  be  an  elaboration  upon  and 
extension  of  Kawara's  fire  support  differential  game  [16],  it  seems  appropriate 
to  review  the  major  results  of  his  work  and  to  relate  our  work  here  to  it. 
In  [16]  Kawara  considers  combat  between  two  heterogeneous  forces,  each  composed 
of  infantry  (the  primary  weapon  system)  and  artillery  (the  supporting  weapon 
system).   The  problem  is  to  determine  the  optimal  strategy  for  each  side  in 
distributing  the  fire  of  its  supporting  weapon  system  over  enemy  target  types 
according  to  the  criterion  of  the  force  ratio  of  infantry  at  the  end  of  the 
prescribed  duration  attack  scenario.   Kawara  concludes  that  each  side  s  optimal 
strategy  for  the  distribution  of  its  supporting  weapon  system's  fire  is  to 
always  concentrate  all  fire  on  the  enemy's  supporting  weapon  system  (counter- 
battery  fire)  during  the  early  stages  of  battle  (if  the  total  prescribed  length 
of  battle  is  long  enough)  and  then  later  to  switch  to  concentration  of  all  fire 
on  the  enemy's  infantry.   He  states  that  this  switching  time  "does  not  depend 
on  the  current  strength  of  either  side  but  only  on  the  effectivenesses  of 
both  sides'  supporting  units"  (p.  951  of  [16]).  Moreover,  an  optimal  strategy 
has  the  property  of  always  requiring  concentration  of  supporting  fires  on 
enemy  infantry  during  the  final  stages  of  battle. 

It  is  indeed  curious  that  Kawara,  who  develops  an  analytic  result  which 
actually  shows  that  the  optimal  strategy  of  one  of  the  players  (the  defender) 
may  depend  upon  force  levels  (see  the  expression  for  T"  and  its  plot  in 
Figure  4  of  [16]),  concludes  that  the  switching  time  at  which  one  changes 
his  optimal  strategy  from  concentration  of  all  one's  supporting  fires  on  the 


* 

Kawara  does  not  determine  the  optimality  of  extremal  strategies  developed  for 

his  problem  (see  [28]  and  also  [25]). 
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enemy's  supporting  units  to  concentration  upon  the  enemy's  primary  ones 
(i.e.  infantry)  is  independent  of  force  levels  but  depends  only  on  the 
effectivenesses  of  both  sides'  supporting  weapon  systems  [16].   Kawara's 
results  as  presented  in  his  Figure  4  clearly  show  that  the  optimal  strategy 
of  one  of  the  players  (for  his  data  set,  the  defender)  is  to  switch  (in  forward 
time)  from  concentrating  all  supporting  fires  upon  the  enemy's  supporting 
weapons  (i.e.  counter-battery  fire  in  the  case  of  artillery)  to  concentrating 
all  fires  upon  his  primary  system  at  an  earlier  (forwards)  time  in  those  cases 
in  which  the  player  is  going  to  lose  all  units  of  his  supporting  system  before 
a  critical  time  (here   t  =  0  -  T1 ) .   We  have  seen  that  such  a  result  occurs 
in  the  solution  to  the  tactical  air-war  game  considered  in  Appendix  B  (see 
Figure  3  of  Appendix  B) .   Such  behavior  was  apparently  first  noted  by  Professor 
Rufus  Isaacs  (see  pp.  101-104  of  [15]),  whose  discussion  is  more  thorough  than 
Kawara's  [16]  but  who  presents  essentially  none  of  the  mathematical  details 
in  [15]. 

Thus,  Kawara  concludes  in  [16]  that  optimal  strategies  do  not  depend 
upon  force  levels.   As  noted  above,  this  is  only  true  provided  that  the  appro- 
priate side's  (in  Kawara's  numerical  example,  the  defender)  supporting  weapon 
system  is  not  reduced  to  a  zero  force  level  before  a  critical  time.   Let  us 
assume,  therefore,  that  neither  side's  supporting  weapon  system  can  be  reduced 
to  a  zero  force  level.    Then  the  optimal  strategies  are  independent  of  force 
levels,  and  this  property  of  the  optimal  strategies  is  readily  seen  to  be  a 
function  of  the  criterion  functional  for  a  given  set  of  combat  attrition 
equations.   We  will  show  that  Kawara  considered  in  [16]  the  only  type  of  objec- 
tive function  (i.e.  criterion  functional)  which  yields  optimal  strategies 


Initial  force  levels  and  the  known  length  of  battle  may  be  sufficient  to 
guarantee  this  for  a  given  set  (or  range  of  values  of)  Lanchester  attrition- 
rate  coefficients. 
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independent  of  force  levels.    Kawara  s  criterion  functional  is  a  special  case 
of  a  more  general  one  considered  in  this  appendix.   The  adoption  of  a  criterion 
functional  of  this  general  form  will  be  shown  to  be  a  necessary  (as  well  as 
sufficient)  condition  for  the  optimal  strategies  to  be  independent  of  force 
levels.     In  other  words,  Kawara  essentially  used  the  only  objective  function 
that  yields  the  above  results  reported  by  him.   For  any  other  form  of  criterion 
functional,  the  (forwards)  time  at  which  a  side  changes  from  concentration  of 
all  fire  on  the  enemy's  supporting  units  to  his  primary  ones  in  following  an 
optimal  strategy  will  depend  upon  the  force  levels. 

The  importance  to  military  analysis  of  the  above  property  of  the  optimal 
strategies  is  obvious.   If  the  statement  [16]  that  optimal  strategies  do  not 
depend  on  current  force  levels  is  taken  literally,  it  means  that  one  may  use 
an  open  loop  strategy,  i.e.   u  =  u(t;tf.,x_),   for  optimal  results.   This  means 
that  it  is  optimal  to  use  a  pre-programmed  attack  strategy  (not  depending  upon 
(intelligence  estimates  of)  initial  force  levels  or  even  the  dynamic  evolution 
of  combat).   This  is,  indeed,  a  dangerous  conclusion  to  reach,  since  it  may 
mean  the  difference,  for  example,  between  a  successful  and  an  unsuccessful 
amphibious  landing.   Moreover,  this  conclusion  is  not  even  true  for  the  problem 
considered  by  Kawara,  and  a  minor  variation  in  Kawara' s  model  leads  to  optimal 
strategies  which  depend  directly  upon  the  force  levels. 

Thus,  our  purpose  in  this  appendix  is  to  clarify  the  dependence  of  the 
structure  of  the  optimal  strategies  (at  least  for  the  case  in  which  neither 


As  noted  above,  this  is  provided  that  the  appropriate  side's  (in  Kawara' s  case, 
the  defender)  supporting  weapon  system  is  not  reduced  to  a  zero  force  level. 

As  qualified  in  the  previous  footnote,  this  is  only  true  provided  that  the 
appropriate  side's  (in  Kawara 's  case,  the  defender)  supporting  weapon  system 
is  not  reduced  to  a  zero  force  level.   We  have  assumed  above  that  this  condition 
is  satisfied. 
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side's  supporting  units  are  all  lost)  upon  model  form  (i.e.  the  combination 
of  the  type  of  attrition  equations  and  the  nature  of  the  criterion  functional). 
We  then  consider  a  slight  variation  in  Kawara's  problem  for  which  the  structure 
of  the  optimal  strategy  of  one  of  the  combatants  is  significantly  different 
than  that  in  the  original  problem  [16]:   the  optimal  strategy  of  one  combatant 
depends  directly  upon  the  enemy's  force  levels  and  is  no  longer  to  always  con- 
centrate all  fire  on  either  the  enemy's  primary  or  supporting  weapon  system. 
Furthermore,  we  will  show  that  an  optimal  strategy  in  which  a  side  divides 
the  fire  of  its  supporting  weapon  system  between  the  enemy's  primary  (infantry) 
and  supporting  systems  can  only  occur  when  the  enemy's  infantry  has  some 
effectiveness  (in  the  sense  of  a  non-zero  Lanchester  attrition-rate  coefficient) 
against  his  infantry.   The  optimal  strategy  of  one  side  to  sometimes  split  its 
fire  is  very  similar  to  that  which  occurs  in  a  one-sided  (optimal  control) 
problem  previously  considered  by  us  [26]  (see  also  [27])  for  the  optimal  dis- 
tribution of  fire  by  a  homogeneous  force  in  combat  against  homogeneous  forces. 
In  [26]  the  enemy  consisted  of  two  weapon  system  types,  each  of  which  undergoes 
attrition  at  a  rate  proportional  to  the  product  of  the  numbers  of  firers  and 
targets  (referred  to,  for  convenience,  as  "linear-law"  attrition).   In  fact, 
this  previous  work  of  ours  [26]  was  the  motivation  for  our  examination  here 
of  other  attrition  structures  in  Kawara's  problem. 

2.   On  the  Relationship  Between  the  Objective  Function  and  the  Structure  of 
the  Optimal  Fire-Support  Strategies  in  Kawara's  Fire  Support  Differential 
Game. 

In  the  recent  paper  [16]  Kawara  considered  the  attack  of  heterogeneous 

X  forces  against  the  static  defense  of  heterogeneous  Y   forces.   Both  the 

X  and  Y   forces  are  composed  of  two  types  of  units:   primary  units  (or  infantry) 
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and  fire  support  units  (or  artillery).   The   X  infantry  (denoted  as  X.. ) 
launches  an  attack  against  the  Y   infantry  (denoted  as  Y  ).   We  consider 
that  phase  of  the  attack  which  may  be  called  the  "approach  to  contact."  This 
is  the  time  from  the  initiation  of  the  advance  of  the   X..   forces  towards  the 
Y   defensive  position  until  the   X   forces  actually  make  contact  with  the 
enemy  infantry.   It  is  assumed  that  this  time  is  fixed  and  known  to  both 
sides  and  that  infantry  fire  has  negligible  effectiveness  against  the  enemy's 
infantry  during  this  time.   During  this  time  the  fire  support  units  remain 
stationary,  and  each  unit  has  the  capability  to  deliver  either  "point-fire" 
counterbattery  fire  against  enemy  artillery  or  "area  fire"  against  the  enemy's 
infantry. 

It  is  the  objective  of  each  side  to  attain  the  most  favorable  force 
ratio  of  infantry  possible  at  the  end  of  the  "approach  to  contact"  at  which 
time  the  force  separation  between  the  opposing  infantries  is  zero  and  artillery 
fires  must  be  lifted  from  the  enemy's  infantry  in  order  not  to  also  kill  friendly 
forces.   Thus,  the  decision  problem  facing  each  commander  is  to  determine  the 
"best"  distribution  of  artillery  fire  over  time  between  enemy  infantry  and 
enemy  artillery  in  order  to  maximize  the  quotient  of  friendly  infantry  (numerical) 
strength  divided  by  enemy  infantry  strength  at  the  end  of  the  approach  to  con- 
tact.  This  situation  is  shown  diagrammatically  in  Figure  1.   The  reader  is 
referred  to  Kawara's  paper  [16]  for  further  details  of  the  model's  development. 
It  should  be  pointed  out  that  this  model  also  applies  to  the  case  of  an  amphib- 
ious landing  and  the  determination  of  the  optimal  allocation  of  Naval  ship-gun 
fire  support. 
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Artill 


rtillery 


Figure  1.   Diagram  of  Kawara's  Fire  Support 
Differential  Game. 


Mathematically,  the  problem  may  be  stated  as  the  following, 

x,(tj 


maximize  minimi 
U 


ft^}' 


with  stopping  rule 


subject  to: 
(battle  dynamics) 


tf  -  T  =  0, 

dxl 

—  =  -valXly2, 

dx2 

dt~  =  -(1'v)a2y2' 

dT~  =  "ubiyix2' 

dy2 

—  =  -(l-u)b2x2> 


(1) 
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with  initial  conditions 

x.(t=0)  =  x°   and   y.(t=0)  =  y°   for   i  =  1,2, 
i        1       ^x        J 1 

and 

x  ,x  ,y1,y2  ^0    (State  Variable  Inequality  Constraints), 

0  2.  u,v  s»  l    (Strategic  Variable  Inequality  Constraints), 


where 


x  (t)   is  the  number  of  X  infantry  (i.e.   X  )  at  time   t, 

x  (t)   is  the  number  of  X  artillery  (i.e.   X  )  at  time   t, 

similarly  for  y  (t)   and  y  (t), 

a.   is  a  constant  (Lanchester)  attrition-rate  coefficient 
l 

(reflecting  the  effectiveness  of  Y   fire  against  X.), 

similarly  for  b., 
l 

and      u(v)   is  the  fraction  of  X(Y)   artillery  fire  directed  at  opposing 

infantry  forces. 

It  should  be  noted  that  for  T  <  +°°   it  follows  that  we  will  always  have 

x  (t),y1(t)  >  0.   Thus,  the  only  state  variable  inequality  constraints  (SVIC's) 

that  must  be  considered  are   x9>y9  ^  0. 

Kawara's  results  and  conclusions  [16]  have  been  discussed  in  Section  1 
above.   Let  us  assume  that  neither  side's  artillery  is  reduced  to  a  zero 
force  level.   Then  we  will  show  that  Kawara  in  his  paper  [16]  chose  only  the 
possible  type  of  criterion  functional  which  yields  optimal  fire  support 
strategies  that  are  independent  of  force  levels.   We  will  do  this  for  two 
cases:   (1)  only  infantry  considered  in  the  criterion  functional  and  (2)  all 
force  types  considered  in  the  criterion  functional. 
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Before  we  develop  the  above  results,  it  is  convenient  to  first  establish 
some  preliminary  results  regarding  the  characterization  of  an  optimal  fire 
support  strategy  (i.e.  the  basic  necessary  conditions  of  optimality) .   For 
x  ,x_,y  ,y„  >  0,   the  Hamiltonian  is  given  by  [7] 

H(t'^»yjR,'^u'v)  =  "plvalxiy2  "  P2^1_V^a2y2  "  qlublyiX2  "  cl2^1_U^b2X2'    ^ 

where  we  have  adopted  the  following  correspondences  between  state  and  adjoint 

variables : 

state  variable  dual  variable 

x.  p .        for   i  =  1,2, 

l  l 

y.  q.        for   i  =  1,2. 

The  adjoint  system  of  differential  equations  for  the  dual  variables  is 

dt"  =  "  ^Tx  =  v*aiy2pr  (3) 

dP9       3H 

=  u^y^  +  (l-u*)b2q2,  (4) 

-  u*b1x2q1,  (5) 

dt      8y2  =  V*alXlPl  +  (1"vA)a2P2-  (6) 

When  x  ,x  ,y  ,y   >  0,   the  extremal  strategic-variable  pair,  denoted 
as   (u*,v*),   is  determined  by  the  max-min  principle.   Hence,  we  consider 

maximize  minimize  H(t ,x,y^,p^,c^,u,v)  .  (7) 


dt 

3x; 

dq, 

8H 

dt 

ay, 

dq2 

3H 

Thus,  for  y  ,y   >  0,   we  have 


1   for   S  (t)  >  0, 


u*(t)  =  <  (8) 

0   for   S  (t)  <  0, 
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where  the   u-switching  function,   S  (t),   is  defined  by 


u 


S  (t)  =  b1(-q1(t))y1(t)  -  b.(-q,(t)).  (9) 


u 


lv  Hlvw;;rw    "2K   H2 


Similarly,  for  x  ,x~  >  0,   we  have 


1   for   S  (t)  >  0, 
v*(t)  =  I  (10) 


(t)  =  J 

\    0   for   S  (t)  <  0, 


where  the  v-switching  function,   S  (t),   is  defined  by 

Sv(t)  =  alPl(t)Xl(t)  -  a2p2(t).  (11) 

For  future  purposes,  it  is  convenient  to  note  the  following: 

p  (t)x  (t)  =  constant,  (12) 

and 

q  (t)y  (t)  =  constant.  (13) 

Both  these  results  are  readily  established  by  direct  computation  using  the 
state  and  adjoint  equations.   Using  the  boundary  conditions  for  the  adjoint 
variables  at   t  =  tf,   one  can  easily  show  that  the  constant  in  (12)  is 
positive,  while  that  in  (13)  is  negative.   Since  an  extremal  trajectory  is 
synthesized  by  working  backwards  from  the  end  at   tf  =  T,   it  is  convenient 
to  introduce  the  backwards  time  t   defined  by 

t  =  T  -  t.  (14) 

Then,  it  is  readily  shown  that  the  switching  functions  satisfy  the  following 

differential  equations 

dS 

1  =  (l-v*)b„S  (t)  -  b.a1p1(t)x.(t),  (15) 


dT   v-  ,-"2~v***      irr'  i 


ft 
By  an  extremal  trajectory  we  mean  a  path  on  which  the  necessary  conditions  of 

optimality  are  satisfied  everywhere  in  time. 
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dS 

~t   =  (l-u*)a2Su(x)  -  a2b1(-q1(t))y1(t).  (16) 

dS  dS 

From  (15)  and  (16),  it  should  be  noted  that  — -  <  0   and  3—^  <  0   for  all 

dT  ClT 

t  ^  0.   Thus,  we  see  that  singular  subarcs  (see  [6],  [12],  [25])  are  impossible 
for  the  problem  (1). 

2.1.   Case  in  Which  Only  Infantry  Considered  in  Criterion  Functional. 

We  will  first  examine  the  case  in  which  only  infantry  is  considered 

in  the  criterion  functional.   It  is  convenient  to  re-write  the  problem  (1) 

as  follows: 

maximize  minimize  G(x..  (T)  ,y  (T) )  ,  (17) 

U        V 

with  stopping  rule:   tf  -  T  =  0,  (18) 

dx 
dt 
dx 


subject  to:  -r— ~  =  -va  x  y_, 


(battle  dynamics) 


'   =   -(l-v)a  v  ,  (19) 


dt     x    '  2y2 

^     b 

—  -  -ubiyix2, 

dy2 

=  -(l-u)b_x_, 


dt     v   w-2"2: 

with  initial  conditions 

x.(t=0)  =  x.   and   y.(=0)  =  y.    for   i  =  1,2, 
x         1  1       J  ± 

and 

x  ,x  ,y  ,y   ^0    (State  Variable  Inequality  Constraints), 

0  ^  u,v  ^  1    (Strategic  Variable  Inequality  Constraints). 

It  seems  appropriate  to  discuss  the  mathematical  properties  of  the 
criterion  functional  (terminal  payoff)   G(x  (T) ,y  (T)) .   We  assume  that  the 
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first  partial  derivative  of  G(x  ,y  )   exists  for  each  of  its  arguments.   Let 
us  recall  that   G(x  ,y  )   is  the  payoff  to   X.   Thus,  it  seems  reasonable  to 
further  assume  that 


3G 


3x1(T) 


>  0    and 


3G 


3yx(T) 


<  0. 


(20) 


We  now  state  and  prove  Theorem  1.   It  should  be  noted  that  all  the 
results  developed  in  the  previous  section  are  independent  of  the  criterion 
functional.   Let  t,   denote  the  "backwards  time"  of  the  first  switch  in  fire 
distribution  as  determined  by  the  optimal  fire  distribution  strategies.   Then, 
we  have 


THEOREM  1:   Assume  that   x 


o 
2' 


y  ,   and   T  are  such  that 


x  (T)  >  0   and  y2(T)  >  0.   Then  t    is  independent 

of   x  (T)   and  y  (T)   if  and  only  if 

k 


G(Xl(T),y;L(T))  =  F 


(x^T)} 


Y^T) 


where   F(u)   is  a  dif f erentiable,  strictly  increasing 
function  of   u   for  u  ^  0   and  k  >  0. 


PROOF:   (a)   Since  x  (T) ,y  (T)  >  0   and  we  assume  that   x  (T) ,y  (T)  >  0, 
the  boundary  conditions  at   t  =  T   for  the  adjoint  variables  are 


3G 


Pl(t=T)  =  3WT) 


P2(t=T)  =  0, 


>  0, 


3G 


qi(t=T)  =  3yn(T) 


q2(t=T)  =  0. 


<  0, 


(21) 
(22) 


Thus,  by  (12)  and  (13)  we  have 


3G 
P2(t)x  (t)  =  constant  =  x^T)    ^    ^  >  0 


(23) 
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3p 

q1(t)y1(t)  =  constant  =  yi(T)  3   (T)  <  0,  (24) 


so  that  the  differential  equations  for  the  switching  functions  are 

dS 


ar  "  <i-v*>WT>  -  ViV^fk  •  (25) 


and 

dS 


1  =    (l-u*)a0S    (t)   +  a0biyi(T)^-^—   ,  (26) 


dr     x*  "  '"2  u       2VV    'ay^T)  ' 
with  initial  conditions 


Su(l=0)  =-biyi(T)  3-^y>0,  (27) 


and 


3r 

Sv(T=0)  =  .^(1)  ^g-  >  0.  (28) 

dS 
It  should  be  noted  that,  for  example,   (l-v*)S  (t)  ^  0   so  that   - —  <  0   and 
dS  dT 

■—■   <  0   for  all   t  ^  0. 

dr 

(b)   By  (27)  and  (28)  and  the  extremal  strategies  (8)  and  (10)  ,  we 
have 

u*(t)  =  1 
(t) 


{  for     t  €  [0,t  ].  (29) 

*  v*(t)  =1 


Using  (29),  the  differential  equations  (25)  and  (26)  are  readily  integrated 
to  yield 

Su(x)  -  -b^T)  j^fc   -  b^TO  ^  t,  (30) 

V*>  "  WT>  i^k  +  a2Vi(T)  ^Jn  T-  (31) 

It  is  also  convenient  to  write  (30)  and  (31)  as 
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Su(°  -  xi(T)  *3n  bi 


-y^T) 

8G 

3yx(T) 

x1(T) 

3G 
Sx1(T) 

-v 


4 


(32) 


and 


Sv(T) 


<"yi(T)  i^fi 


x  (T)    9G 
X1U;  3xn(T) 


-y-,  (T) 


8G 


9y1(T) 


-  a2blT 


(33) 


Now  let 


T-  =  minimum  (t1,t1), 


(34) 


where   t,   is  the  solution  to  the  linear  equation  S  (t=t.)  =  0. 
1  u    1 


(c)   By  (32),  (33),  and  (34),  it  is  clear  that  t    is  independent  of 
x  (T)   and   y  (T)   if  and  only  if 


*1<T>   ix^T 

-y      (T)  SG~ 


=  k  =   constant   >  0. 


(35) 


It  is  convenient  to  write  (35)  as 


!<*>  tajk + ^  wfk 


o. 


(36) 


The  solution  to  the  above  linear  first  order  partial  differential  equation 
(P.D.E.)  is  readily  obtained  by  the  method  of  characteristics  (see  p.  247  of 


[9]).      Thus,      G(x    (T),y    CT))      is   constant   for 

dx^T)        dy^T) 


X](T)        kYl(T)     ' 


or 


(x1(T)}' 

yx(T) 


=   constant 


(37) 
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From  (37),  we  see  that 


G(x1(T),y1(T))  =  F 


r(x1(T)}\ 


(38) 


where   F(u)   is  a  dif ferentiable ,  strictly  increasing  function  of   u  for 
u  £  0   and   k  >  0.   Thus,  Theorem  1  is  proved.   Q.E.D. 


Let   t„   denote  the  "backwards  time"  of  the  second  switch  in  fire 

distribution  as  determined  by  the  optimal  fire  distribution  strategies.   With- 

u     v 
out  loss  of  generality  we  may  assume  that   t..  <  T-  .   Then  we  have 


u*(t)  =  0 
v*(t)  =  1 


for  t  €  (z    tt    ] 


(39) 


We  now  state  and  prove  Theorem  2 


THEOREM  2:   Assume  that   x°  y°    and   T  are  such  that   x  (T)  >  0 
and   y„(T)  >  0.   Then  i        is  independent  of   x  (T) 
and  y  (T)   if  and  only  if   t   is. 


u    v 
PROOF:   (a)   Let  us  first  observe  that  the  assumption   t..  <  t,   implies  that 

S  (t'O  =0  and   S  (t=t1  )  >  0. 
u    1  v    1 


(b)   Using  (39)  and  (33)  with   t  =  T1 ,   we  may  integrate  (26)  to 


obtain 


Sv(T)  = 


1  1     8x  (T)   a  b      1 
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(c)   The  "backwards  time"  of  the  second  switch  in  fire  distribution 

* 
x„   is  the  positive  root  of   S  (t=t-)  =  0   so  that 


a2  b2    h     • 


(40) 


whence  follows  Theorem  2.   Q.E. P. 


As  an  immediate  corollary  to  Theorems  1  and  2  we  have 


COROLLARY  1 : 

Assume  that   x  ,  y  ,   and   T  are  such  that 

x  (T)  >  0 

and   y9(T)  >  0.   Then  the  optimal  fire  support  strate- 

gies for  (17)  through  (19)  are  independent 

of  force 

levels  if  and  only  if 

G(Xl(T),yi(T))  =  F 

f{x1(T)}kS 

i  yx(T)  J  ' 

where   F(u)   is  a  dif f erentiable ,  strictly 

increasing 

function  of   u   for   u  ^  0   and   k  >  0. 

dS  dS 

It  should  be  noted  that  the  fact  that  - <  0   and  -; <  0   for  all 

dx  dx 

x  ^  0   guarantees  that  there  will  be  no  further  switches  in  fire  distribution 
as  determined  by  the  optimal  fire  distribution  strategies. 


2.2.   Case  in  Which  All  Force  Types  Considered  in  Criterion  Functional . 

In  this  case  we  will  show  that  there  is  no  "simple"  criterion  func- 
tional such  that  optimal  fire  support  strategies  are  independent  of  force 
levels.   We  consider  the  foj lowing  differential  game: 


:  u    v 

It  should  be  noted  that  the  assumption  that   x   <  x,   implies  that   x_  >  X- . 

This  follows  from  the  facts  (readily  obtained  from  (32)  and  (33))  that   x   ■ 

x   =  b  /(a  b_k)   and   x   =  a  k/ (a  b  ) .   The  condition  x.    <   x    then  yields 

x,  <  l//a  b   whence   x   >  x    via  (40). 
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maximize  minimize  P(x  (T) ,x  (T) ,y  (T) ,y  (T) ) ,  (41) 

U        V 

with  stopping  rule  and  battle  dynamics  given  by  (18)  and  (19),  respectively. 
We  assume  that  the  first  partial  derivative  of  P(x  ,x_,y  ,y  )  with  respect 
to  each  of  its  arguments  exists  and  that 

>  °»    T-^T  >  0,    TJ"7^-  <  0,    and    -----  <  0-     (42) 


8xx(T)     '        dx2(T)  '    8y1(T)    "'  3y2(T) 

We  now  state  and  prove  Theorem  3.   Let   x ..   denote  the  "backwards  time" 

of  the  first  switch  in  fire  distribution  as  determined  by  the  optimal  fire 

u  v 

distribution  strategies.   Furthermore,  we  have  that   x..  =  minimum  (x  ,x  ), 

where   x.   is  the  solution  to  the  Linear  equation   S  (x=x  )  =  0   and  similarly 

v 
for   x..   Then,  we  have 


THEOREM  3:   Assume  that   x" ,  y°    and   T  are  such  that   x  (T)  >  0 

and   y9(T)  >  0.   Then  both  x    and   x    are  independent 
of   X]L(T),  x2(T),  Y1(T),  and  y2(T)   if  and  only  if 

P(x1(T),x2(T),y1(T),y2(T))  =  R(A,B) , 

where  b1 

(    xl(T)     |k    a-^y2(T) 

Ai[yi(T)]i/k1 e 

bl         -  al 

^y2(T)k-x2(T) 
B  =  y1(T)e        e 


and 


K  =  k/k  with  k  >  k  >  0 


R(A,B)   has  the  following  properties: 

(1)  the  first  partial  derivative  with  respect  to 
each  argument  exists, 

(2)  for   A,B  ^  0 

(a)  it  is  strictly  increasing  in  A  for 
fixed   B, 

(b)  it  is  strictly  increasing  in   B   for 
fixed   A. 
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PROOF:   (a)   Since   x  (T)  ,  y1 (T)  >  0   and  we  assume  that   x  (T) ,y  (T)  >  0, 
the  boundary  conditions  for  the  dual  variables  are 

3P  3P 


(43) 


p2(t=T)  =  ra-  "  °-       i2fr-I)  =  WJv  *  ° 


Then,  by  (12)  and  (13)  we  have 


P1(t)x1(t)  =  constant  =  x] (T)  ^  (T)  >  0, 

9P 
q1(t)y1(t)  »  constant  =  y^T)  J^~(fj  K   °- 


(44) 


As  before,  the  differential  equations  for  the  switching  functions   S  (t)   and 

u 

S  (t)   are  (25)  and  (26)  with  initial  conditions 

r)P  3P 

Su(T"0)  =-biy](T)      y+b2       -, 
and  (45) 

S  (t=0)  =  a  x  (T)  -^j—  -   a 


vvl  "'    Tlu;  Bx^T)    a2    9x2(T)  ' 

dS  dS 

It  should  be  recalled  that  we  have  shown  above  that <  0   and <  0 

dr  dx 

for  all   t  ^  0. 


(b)   Our  interest  is  in  determining  the  class  of  criterion  functionals 

for  which  the  optimal  fire  support  strategies  are  force  level  independent. 

We  are  also  considering  the  special  case  in  which   x_,  y_,   and   T  are  such 

that   x  (T),y  (T)  >  0.   From  (a)  we  see  that   S  (t=0)  ^  0   yields  that 

u*(t)  =0   for   0  £.  t  t>  T  and  similarly  for  v*.   Thus,  for  the  purposes  of 

our  investigation  here  the  cases  in  which   S  (t=0)  £■  0   and/or   S  (x=0)  s-  0 
°  u  v 

are  not  germane,  since  they  are  cases  in  which  independence  of  strategies  from 
force  levels  is  not  a  meaningful  property  to  study.   Therefore,  let  us  consider 
the  case  in  which 
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S  (t=0)  >  0 
u 


and    S  (t=0)  >  0, 

v 


(46) 


where  the  above  are  given  by  (45) . 

(c)   By  (46)  and  the  extremal  strategies  (8)  and  (JO) ,  we  again  have 
(29)  so  that  the  differential  equations  (25)  and  (26)  with  initial  conditions 
(4  5)  yield 


and 


8u(x)  --bl7l(T)  B^rTy  +  b2  8y^y-b2aiXl(T)  *^T)   T  • 


Sy(T)  -  alXl(T)  3-^-  -  a2  ^y  +  a^y^T)  ^y  I 


(47) 


(48) 


It    is   convenient    to  write    the   above   as 


Su(T)    =   V0    ^)"ibl 


3P               2        9P   " 
"ylCT)    3y2(T)        bx  3y2(T) 

-ViT  I- 

v  m       dJ> 

X1U;    3x    (T) 

(49) 


and 


x] 

(T) 

3P 
3xt(T) 

a2        3P 
ax    3x2(T) 

-y^T) 

3P 

3yx(T) 

l2blT    "       (50) 


(d)   By  (49)  we  see  that   t    is  independent  of   x  (T) ,  x9(V),  y  (T) 
and  y9(T)   if  and  only  if 


-y-,(T) 


3P      2    3P 


lv  '  3yj(T)    bx    3y2(T)    j 


x,  (T) 


__3P__ 
3xT(T) 


=  constant  >  0 


(51) 
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Writing   the  above   as 

VT)  S^n  +  kyi(T)  ^m  '  k  F^  3^75)  =  °-  (52) 

we  obtain  (again)  by  the  method  of  characteristics  [8]  that 

P(x1(T),x2(T),y1(T),y2(T))  =  F(a,b),  (53) 

where 

(x  (T)}k 

a  ■  T^or  '  <54) 

and 

bl 

bT  y2(T) 

b  =  y;L(T)e        .  (55) 

(e)   Similarly,   t   is  independent  of  terminal  force  level  values 
if  and  only  if  P  also  satisfies  the  following  first  order  P.D.E. 

xi(T)^  +  kVT)^)-^^y"°-  (56) 

where   k  >  0.   Since  (in  order  that  both   t    and   t   be  independent  of 
force  levels)   P   must  satisfy  both  (52)  and  (56),  the  latter  condition 
places  the  following  requirement  on  any   F  which  satisfies  (53) 

el 

(k-k)u-lr  +  kb  |£-  -^I1  =  0,  (57) 

du      3b    a1  3c 

where  we  have  used  facts  like   y,  (T) t=t-  =  -a  —  +  b  —  .   (This  latter 

1    dy1  ( I )      da     db 

condition  is  merely  a  consequnece  of  the  chain  rule,  of  partial  differentia- 
tion.)  In  obtaining  (57)  we  have  made  use  of  the  fact  that   F  =  F(a,b,c) 
with   c  =  x„(T)   also  satisfies  (53). 
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(f)  Solving  (57)  by  the  method  of  characteristics,  we  obtain 

P(x](T),x2(T),y](T),y2(T))  =  F(a,b,c)  =  R(A,B) , 

i   aI  e 

3.  2.  ~" 

where   A  =  „  ■  ,   B  =  be       ,   and   K  =  k/k.   Using  (54),  (55)  and  the  fact 

bK_1 
that   c  -   x_(T),   we  readily  obtain  the  expressions  for  A  and   B   in  the 

statement  of  Theorem  3. 

9P 

(g)  It  is  obvious  that   A,B  ^  0.   The  conditions  that   r t=^t  >   0   and 

dx  (T) 

3P  3R  3R 

t jwT  >  0   yield  that  — ■  >  0   and  -r—  >  0 .   It  should  be  noted  that   R(A,B) 

oX_  \  i )  dA  at) 

3  P  3  P 

must  be  such  that   -   /mv  <  0   and  — — -y=r-  <   0.   This  implies  that  we  must  have 

3y-i  (T)        3y9(T) 

3A  - 

r j^r  <   0.      Thus,   we   must   have      k>k      (i.e.      K>]),      and    the   proof   of 

9y2(T) 

Theorem  3  is  complete.   Q.E.D. 


Comment:   An  equivalent  form  of  Theorem  3  is  obtained  by  reversing  the  order 
of  solving  equations  (52)  and  (56) . 


As  before,  let   t„   denote  the  "backwards  time"  of  the  second  switch  in 
fire  distribution  as  determined  by  the  optimal  fire  distribution  strategies. 
Without  loss  of  generality  we  may  assume  that   T-  <  T    and  then  (39)  holds. 
We  now  state  and  prove  Theorem  4. 
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THEOREM:  4: 


Assume  that   x  ,  y  , 


and   T  are  such  that 


x,,(T)  >  0   and  y?(T)  >  0   and  assume  that   t   <  t  . 
Let   I   be  independent  of  x  (T) ,  x  (T) ,  y  (T) , 
and  y2(T).   Then  T    is  independent  of   x  (T) ,  x  (T) , 
y-^T),   and  y0(T)   if  and  only  if 


P(x1(T),x2(T),y1(T),y2(T))  =  S(A,B), 


where 


A  = 


(xjd)}' 


-k  t~  y9(T), 

b2   2 


(y1(T)} 


K+l 


and 


-=  v  (T) 

R      „  b2  "2    blV2(T) 
B  =  y1(T)e        o 


k,K  >  0. 


S(A,B)   has  the  following  properties: 

(1)  the  first  partial  derivative  with  respect  to 
each  argument  exists, 

(2)  for  A,B  £  0 

(a)  it  is  strictly  increasing  in   A  for 
fixed   B, 

(b)  it  is  strictly  increasing  in  B   for 
fixed   A. 


PROOF:   (a)   Let  us  first  observe  that  the  assumption   T-.  <  t    implies  that 
S  (t-t,)  =  0   and   S  (t=t  )  >  0.   Furthermore,  we  have  that 


V-V 


-\ 


*i*°  WM 


P 


x^T) 

9P 

a2 

8P     " 
>x2(T) 

3x1(T) 

al   l 

-y^T) 

8P 

ay^T) 

- 

-  a2b,T 


lTM 


(58) 
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(b)   Using  (39)  and  (58),  we  may  integrate  (26)  to  obtain 


SW(T)  -  Sv(T-Tl)  ,  a2biyi(I)  ^  (x-t,)  - 


^  Vl(T)  l^T)    (T"V2-     W 


(c)   The.  "backwards  time"  of  tbe.  second  switch  in  fire  distribution 

* 

t„  is  the  positive  root  of   S  (t-t.)  =  0  so  that 
2  v    1 


3P 


2  2  I    alXl(T)  -a^(T)  ) 


(60) 


wliere 


3P 

3y2(T) 


3P 


aiXl(T)  3x  (T) 


It  should  be  noted  that  (60)  reduces  (as  it  should)  to  (40)  when 

-%—  =  0 
ay2(T) 


9P 

3x9(T) 


(d)  The  assumption  that  t..  is  independent  of  x  (T)  ,  x  (T)  ,  y  (T)  , 
and  y?(T)  yields  that  it  is  both  necessary  and  sufficient  that  P  be  given 
by  (53).   Rewriting  (60)  as 


*2    3P 


1     3P 


fTl  +  T2) 

1 

blT2 

I        2        J 

a2b2 

aib2 

(T) 


b1x2  3x2(T) 


.    .         3P 
1QT;  3x,  (T) 


(61) 


Now,  x       will  be  independent  of  x  (T) ,  x_(T),  y, (T) ,   and  y?(T)   if  and 
only  if  the  right  hand  side  of  (()!)  is  a  constant.   Hence, 


c  u    v 

As  noted  in  the  proof  of  Theorem  2,  it  may  be  shown  that   t.  <  x    implies  that 

x„  >  i . .   The  proof  follows  that  given  previously  above. 


D-25 


v  m    SP      k     9P   ,  r  b2   3P   _  n  ,,.. 

xi(T)  3Xl(T)  ~  b^  ^m  +  k  \  ^oo  -  °»  (62) 

where   k   is  a  constant  (which  may  be  determined  by  (6])).   Since  P  must 
be  given  by  (53),   F  must  also  then  satisfy 

ka  —  +  kb  —  - —  -  =  0,  (63) 

da      3b   b  x   3c 

3P         3F 
where  we  have  used  facts  like   x  (T) p—r-  =  ka  —  -  ,   etc.   In  obtaining 

(63)  we  have  made  use.  of  the  fact  that   F  =  F(a,b,c)   with   c  =  x  (T)   also 

satisfies  (53).   Solving  (63),  we  obtain 


P(x1(T),x2(T),y1(T))  -  F(a,b,c)  =  R(A,B) , 

K         blT2C 
where   A  =  a/b  ,   B  =  be      ,   and  K  =  k/k.   The  expression  for   A  and   B 

given  in  the  statement  of  Theorem  4  are  readily  obtained  via  (54)  and  (55). 

3P 
(e)   It  is  obvious  that   A,B  ^  0.   The  conditions  that      rr~r  >   0 

3P  3R  3R 

and  — — tttt-  >  0   yield  that   x-r  >  0   a^d  ^r  >  0.   It  should  be  noted  that 
3x  (T)      y  oA  3B 

3P  3P 

R(A,B)   must  be  such  that r=r-   <  0   and  — — -rrr-  <  0.   The  latter  condition 

ByjCT)  3y2(T) 

3A 
implies  that  we  must  have r— r-  <  0.   Hence,  we  must  have  K  >  0,   and  the 

proof  of  Theorem  4  is  complete.   Q.E.D. 


Considering  Theorem  3  and  Theorem  4,  we  may  conclude  that  there  is  no 
"simple"  criterion  functional  which  explicitly  contains   x. (T) ,  x_ (T) ,  y1 (T) , 
and   y9(T)   and  yields  optimal  fire  support  strategies  for  (41),  (18),  and 
(19)  which  are  independent  of  force  levels.   We  state  this  as  Corollary  2. 
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COROLLARY  2: 

Assume  that   x  ,  y_ ,   and   T   are  such  that   x  (T)  >  0 

and  y?(T)  >  0.   Then  if  the  criterion  functional  (41) 

depends  explicitly  on   x  (T) ,  x  (T) ,  y,(T),   and  y2(T), 

there  is  no  "simple"  form  for  this  criterion  functional 

such  that  the  optimal  fire  support  strategies  (for  the 

differential  game  defined  by  (41),  (18),  and  (19))  are 

independent  of  force  levels. 

3 .   Another  Model  for  Optimal  Fire-Support  Allocation . 

In  this  section  we  will  consider  a  slightly  different  version  of 

Kawara's  model.   We  will  see,  moreover,  that  the  structure  of  the  optimal 
fire  support  strategy  for  the  attacker  has  a  fundamentally  different  form 

than  that  for  the  previous  problem  (1)  (i.e.  Kawara's  original  problem  [16]): 

the  attacker  must  sometimes  split  his  fire  between  the  defender's  primary  and 

supporting  units  in  order  to  "avoid  overkill."   Furthermore,  the  nature  of 

this  split  depends  upon  the  allocation  of  the  defender's  supporting  fires. 

Let  us  again  consider  the  attack  of  heterogeneous   X   forces  against 
the  static  defense  of  heterogeneous  Y   forces.   Each  side  is  composed  of 
primary  units  (or  infantry)  and  fire  support  units  (or  artillery) .   The  X 
infantry  (denoted  as   X  )   launches  an  attack  against  the  position  held  by 
the  Y   infantry  (denoted  as  Y  ).   Again,  we  will  consider  only  the  "approach 
to  contact"  phase  of  the  battle.   This  phase  is  the  time  from  the  initiation 
of  the  advance  of  the   X   forces  towards  the  Y   defensive  position  until 
the   X..   forces  actually  make  contact  with  the  enemy  infantry.   It  is  assumed 
that  this  time  is  fixed  and  known  to  both  sides. 

The   X   forces  begin  their  advance  against  the  Y   forces  from  a 
distance  and  move  towards  the  Y   position  using  "cover  and  concealment." 
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The  objective  of  the   X    forces  during  the  "approach  to  contact"  is  to 
close  with  the  enemy  position  as  rapidly  as  possible.   Accordingly,  small 
arms  fire  by  the   X    forces  is  held  at  a  minimum  or  firing  is  done  "on  the 
move"  to  facilitate  their  rapid  movement.   It  is  not  unreasonable,  therefore, 
to  assume  that  the  effectiveness  of   X  ' s  fire  "on  the  move"  is  negligible 
against   Y  .   We  assume,  however,  that  the  defensive   Y    fire  causes  attri- 
tion to  the  advancing  X   forces  at  a  rate  proportional  to  the  product  of 
the  numbers  of  firers  and  targets.   Two  possible  justifications  of  this  are 
as  follows:   because  of  the  movement  (and  intermittent  concealment)  of  the 
X1   forces  and  the  distance  involved,  the  Y   defenders  either  (1)  fire  into 
a  constant  (but  moving)  area  without  precise  knowledge  of  the  consequences 
of  their  fire  or  (2)  when  they  do  aim  fire  at   X1   targets,  the  time  to  acquire 
such  a  target  is  inversely  proportional  to  the  density  of  X..   forces  and  much 
greater  than  the  time  to  kill  an  acquired  target.   Under  each  of  these  cir- 
cumstances it  is  well  known  that  the  postulated  form  of  attrition  occurs 
[6],  [31]. 

During  the  "approach  to  contact,"  the  fire  support  units  remain 
stationary.   Each  unit  has  the  capability  to  deliver  counterbattery  fire 
against  enemy  artillery  or  "area  fire"  against  the  enemy's  infantry.   In 
other  words,  we  assume  that  each  side's  fire  support  units  fire  into  the 
(constant)  area  containing  the  enemy's  infantry  without  feedback  as  to  the 
destructiveness  of  this  fire.   On  the  other  hand,  the  effectiveness  of 
counterbattery  fire  is  not  symmetric  with  respect  to  the  two  combatants.   We 
assume  that  the  defender  has  the  capability  (for  example,  through  the  use  of 
aerial  observers)  to  sense  when  an  enemy  supporting  unit  has  been  destroyed 
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so  that  fire  may  be  immediately  shifted  to  a  new  target   and  that  fire  is 
uniformly  distributed  over  the  survivors.     The  attacker,  however,  either 
(1)  does  not  have  the  capability  to  sense  destruction  of  enemy  fire  support 
units  accurately  (and  hence  distributes  his  fire  uniformly  over  the  (constant) 
area  occupied  by  the  defender's  fire  support  units)  or  (2)  if  he  does  have 
adequate  fire  assessment  capability,  then  target  acquisition  times  (which  are 
inversely  proportional  to  the  density  of  the  enemy's  fire  support  units)  are 
much  larger  than  the  time  to  destroy  an  acquired  target.   This  leads  to  a  Y 
attrition  rate  proportional  to  the  product  of  the  numbers  of   X_   firers  and 
Y2   targets  [6],  [31]. 

It  is  the  objective  of  each  side  to  attain  the  most  favorable  infantry 
force  ratio  possible  at  the  end  of  the  "approach  to  contact"  at  which  time  the 
force  separation  between  the  opposing  infantries  is  zero  and  artillery  fires 
must  be  lifted  from  the  enemy's  infantry's  position  in  order  not  to  also  kill 
friendly  forces.   Thus,  the  decision  problem  facing  each  side  is  to  determine 
the  "best"  distribution  of  artillery  fire  between  enemy  infantry  and  artillery 
over  time  in  order  to  maximize  the  infantry  force  ratio  at  the  time  of  contact 
between  the  two  infantry  forces.   This  situation  is  shown  diagrammatically  in 
Figure  2. 


Alternatively,  we  may  think  that  the  attacker  has  massed  so  much  artillery  that 
X£   targets  are  always  easily  acquired  by  Y2   once  an  X2   unit  has  been 
destroyed.   Moreover,  it  will  be  assumed  below  that  the  initial  X2   force 
level  is  sufficiently  ]arge  to  guarantee  that  it  is  never  driven  to  zero. 

This  assumption  is  not  essential  for  the  structure  of   X2 ' s   optimal  fire 
support  strategy.   A  similar  structural  result  may  be  obtained  when  X2 ' s 
attrition  is  the  same  form  as  that  for  Y2 .   We  have  made  the  above  assumption, 
moreover,  so  that  the  resultant  attrition  model  is  most  similar  to  Kawara's  [16' 
but  yet  yields  significantly  different  results  for  the  attacker's  fire  support 
strategy. 
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Figure  2.   Diagram  of  Fire  Support  Differential  Game. 


The  above  assumptions  lead  to  the  following  differential  game  with  an 
attrition  structure  slightly  different  than  that  in  Kawara's  problem  [16]. 

MO 


maximize  mm 

U 


imize  <  — t-t)  , 

v      ly^f)' 


with  stopping  rule:   tf  -  T  =  0, 


subject  to: 
(battle  dynamics) 


=   -anVl   "   Val2XlY2' 


5 

dt 

dx2 

dF  =   -(l-v)a2y2, 


(64) 
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IT  =  -uVix2' 

dy2 

_.  _(1-U)b2y2x2, 

with  initial  conditions 

x.(t=0)  =  x°   and   y.(t=0)  =  y°    for   i  -  1,2, 
i        1         1        i 

and 

x  ,x  ,y  ,y   ^0     (State  Variable  Inequality  Constraints), 

0  ^  u,v  ^  1      (Strategic  Variable  Inequality  Constraints)  , 

where  all  symbols  are  (essentially)  the  same  as  defined  above  for  problem  (1). 

It  should  be  noted  that  for  T  <  +°°  it  follows  that  we  will  always 
have   x  (t),  y- (t)  ,   and  y~(t)  >  0.   Thus,  the  only  state  variable  inequality 
constraint  (SVIC)  that  must  be  considered  is  x~  ^  0.   However,  let  us  further 
assume  that  the  force  level  of  the  attacker's  artillery  is  never  reduced  to 
zero.   In  other  words,  we  consider  the  special  case  in  which  x_   and   T  are 
such  that   x  (T)  >  0. 

4 .   Characterization  of  Optimal  Fire  Distribution  Strategies  for  the  Supporting 
Weapon  Systems. 

It  should  be  clear  that  in  (64)  above  we  have  a  - ,a1 _ ,a_ ,b  ,b_  >  0. 

Although  the  results  of  A.Friedman  [10]  concerning  existence  of  value  do  not 

apply  to  the  original  version  (64)  of  our  fire-support  differential  game,  they 

do  apply  to  a  suitably  modified  version.   If  we  were  to  consider  a  version  of 

dx 

this  problem  with  - —  =  -(l-v)a0y„  +  r„  where   r„  >  0,   then  it  may  be  shown 

dt  III  I 

(see  pp.  210-230  of  [10])  that  this  "modified"  differential  game  has  value  and 
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that  a  saddle  point  exists  in  pure  strategies  (see  pp.  234-235  of  [10]). 
We  will  now  develop  the  basic  necessary  conditions  of  optimality  for  (64) . 
For   x  ,x  ,y  ,y   >  0,   the  Hamiltonian  for  (64)  is  given  by 

H(t'X>X.>H>a,>u'v)  =  "Pl(aHXiyi+val2Xiy2)  "  P2a2(1_v)y2 


q!UbiyiX2  "  q2U-u)b2y2x2, 


(65) 


where  we  have  adopted  the  following  correspondence  between  state  and  adjoint 

variables : 

state  variable  dual  variable 

x.  p. 

l  l 

y .  q .       for   i  =  1,2. 


The  adjoint  system  of  differential  equations  for  the  dual  variables  is 
dp, 


dt 
dp. 


3H 

^  =  ailYlPl  +  V*ai2Y2Pl 


9H 


dt 

Sx7 

dq. 

3H 

dt 

*y, 

dq2 

3H 

-   u*b1yiq1   +    (l-u*)b2y2q2 


-  auVl  +  u^x^ 


with     p    (T)    =  -j  , 


with     p2(T)    =  0, 


with      q2(T)    =   -  — j~^ 


(yp 


3y      =  V*a]2XlPl  +    (l"v*)a2P2  +    (1-u*)b2x2q2     with     q2(T)    =  ° 


(66) 
(67) 
(68) 
(69) 


It  should  be  recalled  (see  Appendix  A)  that   H,   pjt)  ,   and   qjt)   are  con- 
tinuous functions  of  time  except  at  manifolds  of  discontinuity  of  both   U*  and 
V*   (see  Section  4.3  below). 

When   x  ,x  ,y  ,y   >  0,   the  extremal   strategic-variable  pair,  denoted 
as   (u*,v*),   is  determined  by  the  max-min  principle.   Hence,  we  consider 


t 


We  use  the  term  extremal  to  denote  a  trajectory  on  which  the  necessary  condi- 
tions of  optimality  are  satisfied  at  every  point  in  time. 


yl 


and 


(70) 


D-32 


maximize   minimize   H(t  ,x^,  jr, d^, g^, u,  v)  , 
0£u&l  0s>v^l 

so    that 

/    1       for      S    (t)    >   0, 
u*(t)    = 

'    0      for      S    (t)    <   0, 

where  the  U-switching  function,   S  (t) ,   is  given  by 

Su(t)  =  b1(-q1)y1  -  b2(-q2)y2,  (71) 

and 

/  1   for   S  (t)  >  0, 
v*(t)  =  |  (72) 

(  0   for   S  (t)  <  0, 

where  the  V-switching  function,   S  (t) ,   is  given  by 

Sv(t)  =  a11P1x1  -  a2P2-  (73) 

It  is  readily  shown  that 

f 

xl 
p  (t)x1(t)  =  constant  =  p^Tjx^T)  =  -j   ,  (74) 

yl 
f 

ff  W  =all^yl(t)  >0'  (75) 


'  =  -a.(l-u*)S  (t)  -  a0b  a   v.  (76) 


dt      2V    '    uv  '  2  1T1 

We  must  further  investigate  the  possibility  of  singular  subarcs  (see 

[26]  or  Chapter  8  of  [7]).   Let  us  first  show  that  it  is  impossible  to  have 

f 

a  V-singular  subarc.    In  other  words,   v*(t)   must  be   0   or   1   almost 


We  use  capital  letters  to  denote  (closed-loop)  strategies  (e.g.   U  =  U(t,x^,yJ) 
and  corresponding  lower  case  letters  to  denote  the  outcomes  of  strategies, 
or  strategic  variables  (e.g.   u(t)  =  U(t,x,yJ). 
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everywhere  in  time.   The  impossibility  of  a  V-singular  subarc  is  established 

dS 
by  showing  that  77-  >  0   for  all   t  £  [0,T].   It  is  clear  that 

(l-u*)S  (t)  £-  0    for  all   t  €  [0,T].  (77) 

f 

Xl 
Considering  (75)  and  the  fact  that  q  (T)y  (T)  =  -  — 7  <  0,   we  see  that 

q, (t)y1 (t)  <  0   for  all   t  £  [0,T],   whence  follows  "  the  assertion  via  (76). 

3H 
It  is  possible,  however,  to  have  a  U-singular  subarc  on  which  -~—  =  0 

(or,  equivalently,   S  (t)  =  0)   for  a  finite  interval  of  time.   There  are  two 

cases  to  be  considered:   (1)   v*  =  1   and   (2)   v*  =  0. 


4.1.   U-Singular  Subarc  on  Which  V*  =  1. 

When  v*  =  1,   it  is  readily  computed  that 


dS 
u 

dt 


(*i\ 


V 


^ailblyl~a12b2y2^ '  ^78^ 


and 


d2ST 
dT^ 


f 

ex,  ^ 


yl 


-j  x2{(a11b1y1)u*b1  -  (a12b2y2)(l-u*)b2}.         (79) 


SH 
Considering  (71),  the  requirement  that  —  =  0  yields  the  first  condition  for 

du 

a  U-singular  subarc  with  V*  =  1 

biqlyl  =  b2q2y2'  (80) 

Considering  (78)  and  (80),  the  requirement  that  Tz(y~)  =  °   on  a  singular 

3H 
subarc  on  which  -7—  =  0   for  a  finite  interval  of  time  yields  the  second  condi- 
3u 

tion  for  a  U-singular  subarc  with  V*  =  1 


allblyl  =  a12b2y2  (81) 
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On  a  subarc  on  which  the  first  and  second  conditions  for  a  singular  subarc 

hold  we  additionally  require  that  -7—7-  (—- ")  =0   so  that  (79)  yields  the 

dt    du 

singular  strategic  variable  value  required  to  keep  the  system  on  the  singular 
subarc 


u*(t) 


b1+b2 


(82) 


Checking  the  generalized  Legendre-Clebsch  condition   [17],  [18]   »— {— z(^~ )  }  ^  0, 

we  find  that  on  a  subarc  on  which  (80)  and  (81)  hold  we  have 

f 


We  may  write  the  equation  of  the   U-singular  surface  (see  p.  683  of  [26]  as 

(83) 


yl  _  al2b2 
y2  "  allbl 


for   v*  =  1. 


4.2.   U-Singular  Subarc  on  Which  V*  =  0. 

When  v*  =  0,   it  is  readily  computed  that 

f 


dS 
i 

dt 


f    (allbiyral2b2y2)    "  b2y2Sv(t)' 


(84) 


and 


d2S 


dt' 


dS 


=  -u*b,x 


dt  +  a2b2y2{"U*Su(t)+b2q2y2+P2X2[u*br(1"U*)b2]}'   (85) 


so  that  the  first  and  second  conditions  for  a  U-singular  subarc  with  V*  =  0 


are,  respectively,  (81)  and 


ailVl  =   a12b2y2  +  b2y2 


yl^ 


f 

xl 


{-sv(t)}. 


(86) 


This  is  a  necessary  condition  for  optimality.   R.  Isaacs  [15]  gives  an 
equivalent  condition  (see  [13]). 
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It  should  be  noted  (see  [13])  that  the  above  singular  surface  exists  in 
x  -  p^  space.   It  is  convenient  to  write 

—  =  — K~  +  ^~{-S    (t)}    for  v*  =  0. 

y    a  b  f   v 

2    11  1   anb1x1 

The  singular  strategic  variable  value  is  given  by 


(87) 


u*(t)    = 


b1+b2 


1   - 


V2 
P2x2j 


(88) 


The  requirement  that   u*  &  1   yields  that  on  a   U-singular  subarc  with   V*  =  0 
we  must  have 

b2(~q2)y2  S  blP2x2.  (89) 

It  is  readily  checked  that,  the  generalized  Legendre-Clebsch  condition  is 
satisfied. 

4.3.   Discontinuity  of  Adjoint  Variables  Across  Manifold  of  Discontinuity  of 
Both  U*   and  V*. 

It  is  convenient  to  introduce  the  backwards  time   t  defined  by 


x  =  T  -  t. 


(90) 


From  (82)  and  (88),  we  see  that   u*(t)   must  change,  in  general,  discontin- 
uously  from  b2/(b ,+b  )   to  b  /  (b  +b2)  (l-q^/ (p^) )   whenever  v*(t) 
changes  from   1   to   0.   Let  us  consider  the  totality  of  trajectories  on  which 
this  happens.   The  locus  of  points  in  the   t,x^-  space  for  such  simultaneous 
switches  is  then  a  manifold  of  discontinuity  of  both   U*  and   V* .   Across  such 
a  manifold  the  adjoint  variables  need  not  be  continuous  (see  Appendix  A). 

Let   t  -  x    (x,y)   denote  the  backwards  time  at  which   v*(t)   changes 

v    v 

from   1   to   0.   For  future  purposes,  it  will  be  convenient  to  consider  a 
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simultaneous  switch  with   u*   changing  from  the  singular  control   b?/(b  +b_) 
to   1.   Then  the  manifold  of  discontinuity  of  both   U*  and  V*   is  given  by 

F(t,x,yJ  -  t  -  T+  Tv(x,£)  =  0, 

and  (91) 

G(vJ    -   aubiyi   -   a12b2y2   =  0. 

Across  the  manifold  of  discontinuity,  we  have 

T,   +,  T,    -s  3F  3G 

*^         V  fc         V  3x  3x 


and 


or 


and 


T,   +.           T,    -.              3F  3G 

q    (t    )    =   q    (t    )    -  p  -r a   —  -    , 

**       v  **       v  3y  3y 

«<)  ■  H<V  +  p  If  +  "  If  • 


T      +  T      -  8Tv 

PT(tv)    -   pT(tv)    -  p  jJ-  ,  (92) 

(-qi(<)>    -    (-q^V)   +  P   ^  +  aaubl  ,                                  (93) 

(-q2(<»    -    (-q2(r))    +P^-oa12b2  ,                                  (94) 

H(t*)    =  H(t~)    +  p.  (95) 


Considering    (71)    and    (73),    it   is   readily   shown   that 

VTV>    =  0{all(bl)2yi  +  a12<W  +  p(Vl  W]  '  b2y2   3^  »'         (%) 

and 

3t  3t 

S    (t    )    =   -p(a19x1   — V-  -  a9  ---).  (97) 

v     v  12    1    3x  2    3x 
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Recalling   that      u*(0    =  b„/(b.+b_),      u*(t+)    =   1,      v*(t    )    =   1,      and      v*(t+)    -  0, 

V  I  1       I  V  V  V 

3t 

we  may   substitute    (92)    through    (94)    into    (95)    to   obtain   for      a^x^y,      — -  + 

8xv  3t  U   1  1      8xi 

a2y2   3x^  +  biyiX2   3^  *   l 


an(bi)2yiV 


3t         3t  3t 

(l-ailXiyl  3^  "  a2y2  3^  "  biyiX2  3^ 


(98) 


Then  we  may  write 


sX»  ■  "hiV^i +  ai2(b2>2y2 


3t  3t 

ail(bl)2ylX2(bly]   iyf-b2y2    3y7>         v 

__ _1 1_^  (99) 


(]-allXlyl  3x^  "  a2y2  3x7  "  blylX2  3^ 


yl 


and 


3t  3t 

-a   (b  )^y  x  (a  x a  ■= — )a 

11  1   1  2  12  1  3x  2  3x 

S  (x  )  = —  ±  .  (100) 

v  v               3x         3t  3t 

[1-a   x  y ay b  y  x  -z — J 

*■    11  1  1  3x     2  2  3x  112  3y  ' 


5 •   Synthesis  of  _E xtremal  Strategic-Variable  Fair . 

By  the  synthesis  of  the  extremal  strategic  variable  pair  we  mean  the 
explicit  determination  (using  the  basic  necessary  conditions  of  optimality) 
of  the  time  history  of  the  extremal  strategic  variable  pair   (u*,v*)   from 
initial  to  terminal  time  (see  [15]  and  also  [26 ] - [2H 1 ) .   The  basic  idea  is 
to  trace  extremals  backwards  from  the  terminal  manifold  (where  boundary  con- 
ditions for  the  adjoint  variables  arc  known)  in  such  a  way  to  guarantee  the 


f 
It  should  be  kept  in  mind  that,  for  example,   u*(t)  =  U*(t,x^, yj 


D-38 


satisfaction  of  the  initial  conditions.   Thus,  it  is  convenient  to  introduce 
the  backwards  time   t  defined  by  (90) . 

5.1.   Extremal  Transitions  in  Strategic  Variables. 

It  seems  appropriate  to  examine  what  are  the  possible  transitions  (or 

changes)  in  each  strategic  variable  as  we  work  backwards  from  the  end  (i.e. 

8S 

as  t  increases).   It  has  been  shown  above  that  — —  <  0   for  all   x  i.   [0,T]. 

dx 

Considering  the  boundary  conditions  (66)  and  (67)  for  the  adjoint  variables, 
it  follows  that   S  (t=0)  >  0.   Thus 

1   for   0  *■  t  2*  t  , 
v 


v*(t)  =  I  (101) 

'  0   for  t   <  t. 

V 

It  will  be  convenient  to  refer  to  that  phase  of  the  planning  horizon  during 

which  v*(t)  =  0  as   V-Phase  I   (i.e.   0^t<T-x)  and  to  that  during 

v 

which  v*(t)  =  1  as  V-Phase  II. 

Extremal  transitions  in  u*   for  increasing  t   as  shown  in  Figure  3. 

Thus,  this  figure  shows  what  changes  we  might  expect  to  observe  in  u*  as 

we  follow  an  extremal  backwards  from  the  end  of  the  planning  horizon  at   t  =  0 

dS     fx^ 
During  V-Phase  II  when  v*  =  1, 


dx 

b^/V  >  0.   When   u*  =  0,   then  — 
1  1   1  r  dx 

dS     /-x,> 


yi^ 


lYoJ 


fl(allblyra12b2y2)   With   Su(T=0) 
V 
<0.   During  V-Phase  I  when  v*  =  0 , 


yl 


^ailbiyi~a12b2y2^  +  b2y2S  ^ *   Durin8  both  Phases>  the  singular 


dx 

subarc  may  be  exited  with  either   u*  =0   or  u*  =  1.   Once   u*  becomes   0, 

it  remains  this  way.   The  above  statements  will  be  further  justified  below. 


D-39 


u*=u 


u*=l 


u*=0 


Note: 


¥2 
P2x2 


for  v*  =  0, 


for  v*  =  1 


Figure  3.   Extremal  Transitions  in   u*   for  Increasing   x 
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5.2.   Extremal  Synthesis  for  x*  <  x  . 

/ . u v 

From  the  above  we  have 

f 


Xl 
Su(x=0)  =  b  -j   >  0,  (102) 

yi 


so  that  by  (70)  we  have 


u*(t)  -  1   for  0  £  x  £>   x  ,  (103) 

where   t   is  the  smallest  zero  of  the  equation   S  (t=t  )  =  0.   If  the   U- 
u  u    u 

singular  subarc  is  reached  in  V-Phase  II  (see  Section  4.1.  above),  then  let 

us  denote  the  backwards  switching  time  at  which   u*   changes  from   1   to 

b_/(b-+b„)   as   t*.   Clearly,  it  is  necessary  that   T*  <  T    for  this  singular 
2   1   2        u  uv 

subarc  to  appear  in  the  solution.   Thus,  in  general,  there  are  two  cases  to 
be  considered: 

(1)    t*  <  x  , 

U      V 

and  (2)    T*  £  T  . 

U      V 

In  the  report  at  hand,  we  will  only  consider  the  former  case  with  the  latter 

following  along  the  same  general  lines  of  development.   Let  us  therefore, 

f    f    f  f  u   u 

assume  that   a   ,  a  ?,  a  ,  b. ,  b?,  x  ,  x  ,  y  ,   and  y   are  such  that 

T*  <  t  .   We  will  give  numerical  results  for  this  case  below. 
-xl v 

5.2.1.   Extremals  Near  the  Terminal  Manifold. 

dSu  yi 

Recalling  (78),  we  see  that  -3—^  >  0   (<0)   if  and  only  if  —  >  (<) 

a12b2 

r~  .   Considering  (102) ,  it  is  clear  that   S  (x)  >  0   for   v*  =  1  when 

allbl  U      f 

yl    a12b2  Yl  a12b2 

__  >  — _^  #  However,   S  (x)   may  change  sign  when  —p  <   -7—  .   The   U- 

a  .  b  n  u  an  -.  d . 

y2    11  1  y2  11  1 

singular  subarc  occurs  when  both   S  (x=x*)  =  0   and  ainb-y,  =  a10b0y0   at 

uu  11   11  12   II 

x   =   x*.      Thus,      x*      is    the  smallest    root   of 
u  u 
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blX2 


■r  +  T*  + 

r    u 


blX2 


1  2  u    _ 
e        =  0 


(104) 


ailyl 


If  y1      is  given,  then   Su(t=tJ)  -  0   and   a  by   =  a  £b  y   may  be  combined 
to  yield  the  value  of   y    required  in  order  to  reach  the  U-singular  subarc 

f  f    f       f  bl  (anyif~bix?> 

(denoted  as   y  *) .   Thus,  for  a.,y.  +   b,x„  we  have  y^  =  ~  —       / — . 

2  a12(l-blx2TS) 

(Other  results  are  given  below  in  Table  I.)   We  denote  the  corresponding  ratio 


p    f       f* 
of   y    to   y  *   as 


1  * 


When  S  (t=t  )  =  0  with   a^^y..  <  annb_y0,   it  follows  that   t   ii 
u    u  11  1  1     12  2  2  u 

the  smallest  root  of  the  transcendental  equation 


It  may  be  shown  that 


.     aHyl 
b1  -  —T- 

x 

9t 
u 


.   f     aliyi  blX2Tu   n 
al2b2y2Tu  +  —f~   e       =  ° 
X2 
f,  f 


(105) 


>  0  where   r  =  yn/y0.   This  latter  result  is  useful 
9  r  12 

in  proving  the  following: 


THEOREM 

5: 

Assume 

that 

T 

> 

T*. 

Then 

,   U*(T) 

l 

on 

any 

extremal 

V 

u 

f 

f 

as 

long 

as 

V*(l 

■) 

=  1 

for 

yi 
f 

> 

74 

>': 

y2 

y^ 

f   f 
PROOF:   The  proof  is  by  contradiction.   Let   r  =  y,/y9- 

f  (a)   Assume  that  we  could  have  a  switch  in  u*(t)   (with   v'v(t)  =  1) 


for  — ^  > 

y2 
with 


1  * 


T- 


In  other  words,  we  can  find   t   such  that   S  (t=t  )  =  0 

u  u    u 


S  (t)  >  0   for  0  s.  x  <  t  , 
u  u 


(106) 


for  —  > 


1  * 


y- 
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(b)   Consider   r  = 


f     f 
yi    fyil* 


—7-I   +  e   with   e  >  0   and  such  that   x   <  T  , 


3x  3t 

Then  it  may  be  shown  that  -r—  >  0.   In  particular  - — 

<3r  9r 


implies,   however,    that      t      >   x*      for      r  =   r. 

u  u 


r= 


f 


*    >   0.      This 


y2 


1  u*  =  1 

(c)      Observe   that        \     .         n      for     0   ^  x   £  x      <t        so   that      y,  /y„   = 

<  v*  =   1  u  v  J  \   J  2 

f,  f    biV     _ 

yl   y2   6  '      Hence> 

yi  al?b? 

—   (t=t   )    >  -~-^       for     r  =  r,  (107) 

y2         u       anb1 

dS 

since    then     t    (r=r)    >   T*.      It  has  been   shown  above   that     - —  >    0      for     y, /v.   > 
u  u  ._  dT  12 

dS 

a1?b  /(a  b  ).   Thus,  (107)  implies  that  - —  (t=t  )  >  0,   and  hence 

0  =  S  (t=t  )  >  S  (t)   for  t  C  (t  -6  ,t  ).  (108) 

u    u     u  u    u 

This  last  statement  (108)  is  a  contradiction  to  (106)  ,  and  the  theorem  is 
proved.   Q.E.D. 


Other  results  are  obtained  in  a  similar  fashion. 
5.2.2.   Field  Construction. 

T,  •    ,     !         f     f     f  f 

tor  a  given  set  of  terminal  values   x..  ,  x  ,  y  ,   and  y„   an  extremal 
may  be  traced  backwards  from  the  terminal  manifold  by  a  backwards  integration 
of  the  state  and  adjoint  equations  combined  with  (70)  and  (72)  (also  (82)  or 
(88)).   By  varying  these  terminal  values  the  entire  field  of  extremals  (see 
p.  128  of  [7])  may  be  obtained. 

The  various  types  of  extremals  that  may  occur  in  the  field  of  extremals 

are  shown  in  Figure  4.   This  figure  is  representative  of  all  our  numerical 

results  for  t*  <  x    (see  Section  5.2.3  below).   Pertinent  information  con- 
u    v 

cerning  each  type  of  extremal  is  given  in  Table  I. 
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Table  I.   Extremal  Trajectories  for  Fire  Support 


Problem  with  T   <  T  . 
u    v 
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u*(t)  =  1 


>  :  I  for  0  £.  t  £-  t    with 

SO  I   x,  i   ,  u         f 

1  v*(t)  =  1  y0 


f  * 
y2 


T    is  the  smallest  positive  root  of 
u 


1      * 

— £  +  t   + 

u       f     u 

blX2 


blX2   allyl 


u      f  * 
1  )    -blX2Tu    . 


with  the  following  bounds  established: 


for   auy[  >  b^: 


1   „  *     1 

<   T     <   — 

f     u    . 


allyl 


blX2 


for   any^  =  b^: 


*     1 
blX2 


for   a11y]  <  b1x2 


1     *     i 

<  T    < . 

.    f      U  f 

blX2        aiiyi 


for   ay'  ±   b.^ 


f* 


bi   (aiiyrbix2} 

b  f  *   ' 

2  a   (1-b  x  T  ) 
12     1  2  u 


*=  f    u   f 

for   aliy]  =  b^: 


f*  _  allbiyi 
2     a12b2 


Also 


rx 


Sv(t)  -  a2bl 


vy. 


f  -i 


l12   _aiiyi 


a0b1    .        fN? 
.2  1    (b1x2)  -J 


aiiyl 


blX2 


-  1 


f    u   f 

aliyl   blX2T 


(blX2)2 
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Table   I.       (cont.)    -   1 


1.      P 


II 

so: 


(concluded) 


Let 


*  II 

S    (t=t    ).    Also,    on      P  we   have 

V  U  jU 


f  ,          f         f          f         aHyi    ,  b^X2T    nl 
x    (t)    =   xl   expia      y   t    +  £-   (e  -1)}     , 

blX2 


x  (t)  =  x2  , 


,    f 

y  (t)  a  Yj  e 


and 


y2(x)  =  y2 


PjCT) 


P2(x) 


qx(x) 


1             r    r          f         aHyl   <  blV   nil 
-j  exp   Wa12y2T  + j~  (e 


T- 


1  - 


a     v 
llyl 


blX2 


blX2 

aiiyi    ,  biV  m 

t  + 1 —   (e  -1)1    , 


(b^)2 


f , 

yl 


( 


11 


blX2 


V 


all         l]      "blx2\ 
blX2        yl 


q2(T) 


-a 


12 


x^ 


LfJ 
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2.   P 


SI     I 


U*(T)  =  b2/(b1+b2) 

for    T   £.  T  ^  T 
V*(T)  =1  u  V 


*  II 

where   t    is  determined  in   1.   On  P„„   we  have 

u  SI 


S  (t)  =  0, 


and 


allbiyl  =  al2b2y2' 


*  * 

t    is  the  smallest  positive  root  of   S  (t=t  )  =  0,   where 
v  r  v    v 


Sv(T)  =  Sv  +  a2biyi 


y1      (0X2) 


u' 


(y 


i 
I  fJ 


li 


+  a  f 

Xl       *J 


*       11         f     *   ) 
(t-t  ) z —  exp[8x  (x-x  )]  (   , 

u   (ex^)2     2   u  ' 


7* 

nth   6  =  b-b  /(b  +b«).   An  upper  bound  on   t    is  given  by 


Tv=ai2/(a2V- 


Also,  on   P    we  have 


^(t)  =  xl      exp  < 


allyf+al2y2 


f,  r-      f        * 


ex. 


I- 


x2(t)  =  x2  , 

f    * 
+  9x„(t-t  ) 

.    v     u*    2    u 

y-j^-r)  =  y1  e 

f   * 
f    ex  (t-t  ) 

.   N     f     2    u 
y2(t)  =  y2  e 


and 


u*     ( 

P-^t)  =  Pj^  exp  < 


allyl  +al2y2 


ex. 


r  .    f 


9x2(t-t..) 


u>    ill  -^        u*  1    Til 

-lj  [       with      Pl      =  —  \-j 

xi    y^ 


f 


t 

,-rX  "*  U  U*fXll(  ail 

p2(t)  =p2  -  Vi  It  tt7  + 

^y1;     (6  x   Y 


u* 


f  * 

-8x'(T-T     ) 


f       „  f 

Xl  6X2 

f 
x,\  a 


1      "1 

,        *            ail  6X2(T 

(t-t    ) = —  e 

U  (6x2f)2 


"}" 


qx(x)    =   qx      e 


TBi>- 


f  * 

-6x2(t-tJ 


V6X2 


q2(T)    =    q2      e 


"9X     (T-T      ) 


12 


1   -   e 


f  * 

)x2(t-t 
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Table  I.   (cont.)  -  3 


3.   P 


:    <  for   0  s  t  s.  t   with 


u*(x)  =  1 

V*(T)  =  1 


y2    "y2 


T    is  the  smallest  positive  root  of   S  (t=t  )  =  0,   where   S  (t) 
v  r  v    v  v 

is  given  in  1.   An  upper  bound  on  t    is  given  by 


x   = 


'12 


v   a^ 


It  has  been  shown  that   S  (t)  >  0   for   0  s.  t  &   t  .   The  solutions  to  the 

u  v 

state  and  adjoint  equations  are  the  same  as  those  for  P    given  above. 


4.   P 


lv      { 


u*(t)  =  1 
v*(t)  =  0 


for   T   S.  T  £  T 

V         u 


We  have  that   S  (t)  <  0   for   t  >  t    and  that 
v  v 


dS 

-~-   (t)  m   b.,yis  (t)  + 

di         /  2  v 


7i 


j  (a11b1y1(T)-a12b2y^). 


Also,  on  P..   we  have 
Al 

dx 


dT  =  aiiVi      with      *1(T-V  =  V 


x2(x)    =  x2   +  a2y2(T"Tv)' 


a.b.y. 
yi(T)    =  y*  exp{b1x^(T-Tv)   +  -£-^4   (t-Tv)2}, 


and 


y2(T)    =y2> 


dp 


j~-  -«11y1p1    with     Pi<T-V  =  V 


dp2  v 

TT=-Viql         Wlth       P2(T=V=P2' 


dql  Xl  v 

IT  "  'aii  T  "  bix2qi  with  qi(T=V=V 


dq2  v 

—  =  -a2p2   with    q2(t-Tv)  =  q2. 


We  have  not  been  able  to  develop  solutions  in  terms  of  "elementary"  functions 
to  the  equations  for   x  ,   p  ,   p2>   q.,   and  q^. 
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5.   P11: 
3    A2 


u*(t)  =  1 
v*(t)  =  1 


t  II  «r 

for    T_,  £  X  *  X 

SL        v 


t   is  the  smallest  positive  root  of  S  (t=t  )  =  0,  where 
v  r  v    v 


Q  ,  ,    _SLII  ,    .   SLII   1  ( 
Sv(T)  =  Sv    +  a2biyl    TJi 


11 


yl   (blX2)' 


SLII 


'yi 


air 


blX2 


(T_TH)  _   aH   eblX2(T"TSL) 


Again,  an  upper  bound  on  x   is  given  by  a  „/(a„b  ).   It  has  been  shown 
that  S  (x)  >  0   for  x    <  x  £  x  .   Also,  on  P.„  we  have 


SL 


A2 


a„y, 


SLII 


,  N     SLII     I  SLII.    II.     11J1 

xx(t)  -  X;L    exp^a12y2    (x-x^)  +  — — 


f .   II. 


blX2 


x  (x)  =  x2, 

SLII  blX2(T-TSL)' 
yl^T)  =  Yl    e 


,  .     SLII 
y2(T)  =  y2 


-]}• 


and 


,  ,    SLII    (  SLII.   II. 

Pl(x)  =  Pl   exp  -a12y2   (x-x^)  - 


SLII  .   f.    II. 

rblX2(T-TSL)  ,1 
e  -1 


blx2 


with  p 


SLII 


SLII 


fl- 


,  s     SLII   .   SLII)  1W 
P2(T)  -  P,     -  b^     ^U 


f 
x„  ^  ,   a 


11 


yl   (blx2) 


^2 


SLII 


1 

f 


alf 


b2X2J 


(T-TSL} 


ail    blX2(T-TSL) 
e 


<blx2' 2 


!■ 


h  fr         II^ 
,  ,     SLII   -blX2(T-TSL) 

ql(T)  =  ql    e 


(/; 


11 


f .    II, 


b,x. 


{l-e   !  2V    SL'|, 


112 


,  ,     SLII 
q2(x)  =  q2     -  a12 


tf 


D-49 


Table  I.   (cont.)  -  5 

I    i    U*(T)  =  1  I 

6.  P.„:  <  for  t   &  t  £■  t 

A2   '  v*(t)  =0 

Results  are  similar  to  those  for  P.,   above  in  4. 

Al 

u*(x)    =1  ^ 

7.  P~!    <!  for      t     s.  t   s.  x 


A3        '     V*(T)     =    0 


Results  are  similar   to   those   for     PA,      above   in  4. 

Al 

u*(t)  =b2/(b1+b2).(l-q2y2/(p2x2))  -u*        , 
8.   P_„: <  for  t  £  t  £  x 

'  v*(t)  =  0 

As  usual,  we  have  that   S  (t)  <  0   for   t  >  t  .   In  order  for  a 

v  v 

* 
U-singular  subarc  to  be  possible  for   t  £  t    the  following  condition  must 

*- 
hold  at   x  =  x 
v 

I         t 
Also,  on  P„~  we  have 

dxi  *     v* 

—  =  alxxl7l  with  Xl(r=Tv)  -  x2  , 

d*2  *     v* 

—  =  a2y2  with  x2(t=tv)  =  x2  , 

dyl    *  /   *%    v* 

—  =  ugb^^         with  y1(T-tv)  =  yx  , 

dy2       *  •  .     ,   *s    v* 

—  =  (l-us)b2x2y2        with  y2(T=xv)  =  y2  , 


and 


dPi  *      v* 

—  =  -anylPl  with  Pi(t=tv)  =  Pl  , 

dP2  *      V* 

—  =  -blyiqi  with  P2(t-tv)  =  P2  , 

dql       xl    *  ,  K         v* 

—  =  -a  -j  -   "sb1x2q1  with  q1(t-rv)  =  ^    , 

yl 

dC,2  *  *\       V* 

^T  =  "32P2  "  (1-uS)b2X2q2  With  q2(T=Tv)  =  q2  ' 


+A  further  discussion  of  the  continuity  of  the  adjoint  variables  is  to  be  found 
in  Section  5.2.4.  below. 


Table   I.       (cont.)    -  6 
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Bl 


'{ 


u*(t)    =1  y* 

for     0  ^  t  s  x       with     — r  < 
v*(T)    =1  U  y2 


y-j 


V 


x   is  the  smallest  positive  root  of 
u 


bl" 


aiiyi^ 


"   al2b2y2Tu  + 


aiiyl     blVu 


=  0. 


8t 


It  should  be  noted  that 

f  f  * 

Yl         Fl> 

0  <  -T  <    "I 


9r 


■F        f 

>   0,      where      r   =  y   /y    .      It  may  be   shown   that   for 


a12y2 


V  * 

—    <    T        <    T     , 

f  u  u 


where  the  determination  of   x   is  given  in  1.   We  also  have  that 

u 

x  (r..)  <  x  (r~)   for  r  <  r    (x   and  x   held  constant).  The  solutions 

to  the  state  and  adjoint  equations  are  the  same  as  those  for  P  _   given  above. 


Let  S  (t=t  )  =  S  ,   p.  (t=t  )  =  p.,  ,   etc. 
v    u     v    1    u     1 
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Table  I.   (cont.)  -  7 
u       ,  u*(t)  =  0 

10 '   PR9:  \  for   T   S.  T  ^  T 

B2   '  v*(t)  =1 

y 

It  follows  that  for  all   t  >  t   we  have  S  (t)  <  0  and  —  Cc)    < 

u  u  v 

2 
a12b2    ^allbl^ *      Tv     is    the   smallest  positive  root  of     S    (t=t    )    =  0,      where 

S    (t)      is   given  by 


Sv(T)    =  Sv  +  a2b2y 


vy/     (b0x0) 


f 


q2Tj 

-       Xl 


2   2 
al2 


v* 


(T"V    -^I^^^u^}- 


(b2X2)2 


Also,    on     P         we  have 


xl(T)    =  x^  exp{aliy^(T-Tu)   +  -A2-2    [e22         u  -1]}, 

b2x2 

x2(t)    =   -x. 


yl(T)  =  yl» 


f  f 

y2(T)    =  y2  exp{b2x2(x-Tu)}, 


and 


f         U       f/  N 

a10y.        b_x-(x-T    ) 


Pi(t)   =  pj1  exp{-auy5l(T-Tu)    -  -^  [e   2   2  u  -1]}     with     P*  -  ^ 


b2x2 


fl. 


1   'l 


P2(x)   =  p2  -  b2y2 


fXll/      al2  ufyi 

^u~T7  +  q2i 

Ky±     (b2x2)z      |_    ^ 


+ 


12 


b2X2- 


(t-t    )    - 


12 


b2x    (t-t..) 


(b2X2>2 


'■ 


qx(T)    -  q2   "  au 


f 


^ 


(t-t    ), 
u 


q2(T)    = 


a-  $ 

yl  b2X2 


+ 


12     4  U 

F+q2 


b2x2 


X 


f  -I 

r 

I 
1  - 


-b2X2(T-Tu)l 
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Table  I.   (cont.)  -  8 


11.   P 


II, 
B3: 


/  u*(t)  =  0 
'  v*(t)  =  1 


for   TriT  &  T  &  T 

SL        v 


T   is  the  smallest  positive  root  of   S  (t=t  )  =  0,   where 
v  v    v 


.  ,  N    _SLII     .   SLII 
S  (t)  =  S     +  a  by 
v       v       2  2  2 


f 


I      al2 


SLII 


7^ 


wx. 


12 


b2x^ 


(T-TSL)  " 


l        b2X2(T-TSL); 

e 


(b2x2)2 


Again,  an  upper  bound  on  t   is  given  by  a  _/(a  b  ).   It  may  be  shown  that 
S  (t)  <  0   for  all  x  >  t   .   Also,  on  P    we  have 

U  bL  D  j 


,  ,    SLII    ,    SLII.   IIN    a12y2 

X1(T)  =  Xl    exp{aHyl    (T-TSL)  +  — T 

b2x2 


SLII 


b  x  (t-tct ) 


[e 


2  2 


SV 


-1]}, 


x2(x)  =  x2, 


,  .     SLII 
yi(T^  =  yl 


,       .  SLII         ,,      f,  IIv, 

y2(t)  -  y2    exp{b2x2(T-TSL)}, 


and  SLI1   h  fr   Th 

,    s  SLII    ,     SLII.   IIN   al2y2     .   2X2('T  TSL;  _  .,    .  .    SLII     1 

Pl(T)=Pl   exV{-allVl        (t-tsl)  -  [e  -1]}  wxth  p     ="^1 

b2x2  x     *y 


J). 


,    .  SLII        .       SLII      1    I 

P2(t)    =  p2         -  b2y2         7| 


12 


+ 


y[JX0>2^2)2 


SLII 


a- 


12 


Xl 


b2x2J 


(T-TSL)    ' 


12  2   2 

e 


b„x„(x-TOT  ) 


(b2x2>2 


'SL' 


}• 


,    N  SLII 

qi(T)    =  qi  "   ail 


rx 


«  ■  iH- 


12 


3-1/         IXN 


12    .      SLII 


V        b2X2 


f  -i 


-b2X2 


f  +  q2 


flrxi 


^x 


1  J 


jb^CT-^)   v 
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,   P*  :  { 

B4   «  v*(T)  =  0 


Table  I.   (cont.)  -  9 
u*(t)  =  0 


12.  for  t*  s.  t 

V 


It  may  be  shown  that  S  (t)  <  0  and  S  (x )  <  0   for  all  t  >  t  .   Also, 

u  v  v 


on  P„.   we  have 
B4 


.  .     v*     r     v*     *  i 
^(t)  m  x±     exp{a11y1  (t-t^)} 


/  v*  9    a2  v*  *  2   v*  9  v* 

Ax2  )2  -  -^  y2  coth(-A(T-tv)+B)  for  -f  (xj  )2  >  a^  , 

v*,r.  2     v*  *   -,  ,.  2  t  v*   2  v* 

x2(t)    =  <T    x2   /ll  -  -y  x2    (t-t   )}  for     "2~  (x2   )  a2y2    ' 

/2     v*  v*  9  *  2       v*   o  v* 

-^•y2     -    (x2   )2   tan(C(T-Tv)+D)  for     -f  (x^   )2   <  a^    , 

yx(T)  -  y-L 


'b    (x2   )  \  b 

-^ y2    )/sinh2(-A(x-Tv)+B)      for     -f  (x2   )2   >  a2y2    , 


/    \  7      V*/r,  2      V*,         *.i2  .  2    ,    v*    2  v* 

y2(T)   =  /  y2   /{I  -  T  x2    (x-Tv)}  for     —  (x2   )2  =  a2y2    , 


v*  2         v*  .         o  *  2    ,   v*    9  v* 

(y2     ~   it   (X2   }    )/c°S    <C<T-TV>+D)      for       2     <x2   >      <  a2y2    ' 


A  =  ^/^ 


9         2a2      V* 
where     A  =  —J  (x     )z  -  -g —  y2    , 


Table   I.       (cont.)    -   10 
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12.      P„, :      (concluded) 
B4 


v* 


B   =   coth 


-II 


V*N2 


2a, 


(X2  >'  "  T 


4 

v*/ 


and 


C  = 


/2a2     v* 

/-bTy2    " 


^2 

2    V    b 


(xf)2 


D  =    tan 


-1, 


^ 


V*  \ 

^yf-(xf)2/ 


P^T) 


Px     expl-a.^^    (t-tv)}     wxth     v± 


f 
rx„  ^ 


1      '1 


Ti 


dP2  „ 

dT  =  "b2y2q2 


with     p2(t=Tv)    =  p2    , 


qx(T) 


v* 
=  q,     -  a 


11 


1  * 

yl 


d<l2 

dT~  =  "a2P2  "  b2X2q2 


*     v* 
with  q2(T=Tv)  =  q2  , 


We  have  not  been  able  to  develop  solutions  in  terms  of  "elementary"  functions 


to  the  equations  for  p   and  q  . 


Table  I.   (concluded)  -  11 
u*(t)  =  0 


13.  ?l2     and  PJ3:  for 


,1  .  J 

B3   I  v*(t)  =  0 


Results  are  similar  to  those  for  P_.   above  in  12. 

B4 


!    ,  u*(t)  =  0 
"•   PB5:     £°r  TSLST 


Results  are  similar  to  those  for  P_.   above  in  12, 

B4 


T    /  u*(t)  =  1 

15 •    PA/:   { 

M    <V*(T)  =  0 


u*(t)  =1        z         j 

for   T„T  £  T  £»  T 
SL        u 


Results  are  similar  to  those  for  P..   above  in  4 

Al 
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5.2.3.   Numerical  Examples. 

In  this  section  the  results  of  some  numerical  computations  are  presented 
and  discussed.   A  computer  program  which  calculates  the  information  given  in 
Table  I  was  developed  in  FORTRAN  for  the  IBM  360  computer.   I  would  like  to 
thank  CPT  Jeffrey  L.  Ellis,  U.S.  Army  for  his  efforts  on  this  project.   This 
computer  program  outputs  a  plot  representing  the  field  of  extremals  (see 
Figures  5  and  6  below).   The  closed-form  analytic  results  presented  in  Table  I 

are  used  whenever  possible.   Approximate  numerical  solutions  to  transcendental 

* 
equations  (for  the  determination  of,  for  example,   t  ,   t  ,   etc.)   are  developed 

by  the  well-known  Newton-Raphson  method.   In  those  cases  for  which  closed-form 
solutions  are  not  available  to  the  state  and  adjoint  equations,  a  standard 
fourth  order  Runge-Kutta  numerical  integration  method  is  used.   A  time  step, 
At,   was  used  in  these  numerical  integrations  which  yielded  agreement  to  the 
fifth  place  to  the  right  of  the  decimal  place  in  test  cases  in  which  the  approx- 
imate numerical  solution  could  be  compared  with  the  exact  solution. 

Parameter  sets  for  the  numerical  examples  considered  in  this  report  are 
given  in  Table  II.   In  the  problem  (64)  at  hand  we  may  consider  time  to  be  an 
additional  state  variable  so  that  the  state  space  in  five  dimensional,  i.e. 
the  state  variables  are   t,   x- ,   x~,   y  ,   and  y„.   Thus,  unfortunately,  we 
cannot  graphically  depict  the  field  of  extremal  trajectories,  since  this  would 
involve  curves  in  a  five-dimensional  space. 

Table  II.   Parameter  Sets  Used  to  Generate  Numerical 
Results  Shown  in  Figures  5  and  6. 

Parameter  ,       ,        f     f      f 

Set      fll     fl2     f2     \  b_2  !l    f2     12 

1  0.003   0.006   0.01   0.004   0.005   4.0   8.0   8.964 

2  0.003   0.006   0.01   0.004   0.005   4.0   8.0  11.597 
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The  most  illuminating  plot  for  gaining  insight  into  the  structure  of  the 
optimal  fire  support  strategies  for  (64)  is  that  of  extremal  trajectories  in 
terms  of  Y-i^Yn     versus  backwards  time,   x.   This  is  shown  for  parameter  set 
1  in  Figure  5.   The  corresponding  strategic  variable  values  for  X  and  Y 
(i.e.   u*  and  v*)   along  each  extremal  are  also  given.   Other  plots  have 
been  considered,  but  they  provide  little,  if  any,  additional  insight. 

The  most  significant  features  of  the  field  of  extremals  shown  in  Figure 
5  are  the  two  U-singular  "surfaces":   there  is  one  in  x,y  -  p,q   space  in 
V-phase  I  and  one  in  y-space  in  V-phase  II.   In  each  phase,  X  uses  the 
strategy  U  =  1  above  the  singular  "surface"  and  the  strategy  U  =  below  it. 
Similar  to  our  discussion  in  [27],  the  singular  surfaces  are  present  in  the 
field  of  optimal  trajectories  so  that  the  X  artillery  avoids  "overkilling" 
either  Y   or  Y  .   This  is  obvious  when  one,  for  example,  considers 


m 


x2       Vr 

Thus,  the  rate  of  destruction  of  Y   per  unit  of  X  artillery  decreases  over 
time  as  the  Y   force  level  decreases  (see  [26]  and  [27]). 

Results  for  parameter  set  2  are  shown  in  Figure  6.   There  is  a  void 
(see  p.  169  and  also  p.  187  of  [15])  in  the  field  of  extremals.   This  is  because 

•k 

in  backwards   time   at   the   end     x        of   the      U-singular   subarc   in     V-phase   II,   we 

v 

ft+ 
would  have  u  (x   )   (as  given  in  Figure  3)  equal  to  1.054  if  the  adjoint 

o    V 

•k 

variables  were  continuous  at   x  .   The  following  theorem  further  explains  this 

v 

situation. 
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60 
Backwards  Time,   t   (minutes) 


Figure  5.   Plot  of  —  versus  Backwards  Time,   t,   for 

y2 
Field  of  Extremals  for  Parameter  Set  1. 
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60 
Backwards  Time,   t   (minutes) 


(t=T) 


Figure  6.   Void  in  Field  of  Extremals  Shown  in  Plot  of  — 

y2 
versus  Backwards  Time,   t,   for  Parameter  Set  2. 
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THEOREM  6: 

There  can  be  no   U-singular  subarc  beginning  in 

backwards  time  at   t   with  a.-b.y.  =  a10b_y0   for 

v         11  r  1    12  2  2 

blP2(Vx2  +  b2VT>2  *  °" 

When  a  U-singular  subarc  begins  at   T   with 

a  by  =  a  „b  y  ,   there  is  no  discontinuity  in  the 

adjoint  variables  at   t  =  t    (i.e.  a  =  0      in  (99)). 

PROOF:   Immediate  by  (89)  and  (99). 


Q.E.D, 


Additionally,  Theorem  7  gives  the  extremal  transitions  in  X's  strategy  possible 

from  the  U-singular  surface  in  V-phase  II  as  we  work  backwards  from  x  .   Thus, 

since  bnp„(x  )x~  <  b~(-q~(x  ))y~   for  parameter  set  2,  a  void  would  exist  in 
12  v  2    2   2  v   2 

the  field  of  extremals  if  the  adjoint  variables  were  continuous  at   x  . 


THEOREM  7:   Assume  that  there  is  no  discontinuity  in  the  adjoint 

variables  at   x  =  x   with  a^b.y.  =  anob.y_.   Then 

v  11   1   1  12   2   2 

I.    if     b   p    (x    )x2   <  b2(-q2(xv))y2,      then  we  can  only 
have      u*(x)    =  0      for     x    €   (x    ,x  +6)      where     6    >   0, 

II.    if     b   p    (x    )x     ^  D2(~cl2^Tv^y2,      then  We  °an  haVG 
I  (a)      0, 


u*(x)    =    I   (b)       (l-q2y2/(p2x2))  •b2/(b1+b2) 


(c)       1, 


for     x   t   (x    ,x  +6)     where      6    >  0 
v     v 


*_ 

PROOF:   (a)   When  we  are  on  the  singular  surface  in  V-phase  II  at   x   =  x 

then  by  (84)  and  (85)  and  the  continuity  of  the  dual  variables  we  have 

S  (x=x+)  =  S  (x=x+)  =  0, 

U      V       U      V 


and 


*S*<T-T+)  -  a2b2(b1+b2)p2x2y2{u*(<)- 


b1+b2 


1   " 


q2y2^ 


P2x2j 


}  , 


dS 

where   S   denotes  - — 
u  dx 
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(109) 


(b)   Considering  a  Taylor  series  expansion  about  T  =  x  ,   we  have  by 


+    *+ 
the  above  for  x  ^  x  =  x 

v    v 


(t-x  )2  00 
Su(x)  — 2*-S  (r), 


(110) 


where  x  €  (x  ,x) 


(c)   When  u*(x)  =  0   for  x  €  (x  ,x  +6),   then 

v  v 


Su(t=Tv+)  =  -a2(b2)2P2x2y2 


1  - 


q2y2l 


P2x2J 


<  o, 


so  that  3  5,  >  0  such  that   S  (x)  <  0   for  all  x  £  (x  ,x  +5,).   Thus,  we 
1                 u  v  v  1 

can  always  have  u*  =  0  as  we  work  backwards  in  V-phase  I  from  the  U-singular 
subarc  in  V-phase  II. 


(d)   Now  let  blP2(x*)x2  ^  b2(-q2(x*))y2.   By  (88) ,  the  U-singular 

control  in  V-phase  I  u  =  (1-q  y?/(p?x  ))  *b  /(b  +b?)  £  1.   Thus,  the 

*+  °  °     *+. 

U-singular  subarc  is  possible.   When  u*(x   )  =  1,   then  S  (x=x   )  ^  0  by 

v  u    v 

(109).   When  inequality  holds,  it  follows  that  3  6   >  0  such  that   S  (x)  >  0 

*   *  * 

for  all   x  t  (x  ,x  +6.).   Clearly,  we  cannot  have  u*  =  1  if  b.p-(x  )x0  < 
vvl  lzvz 


b2(-q2(xv))y2. 


Q.E.D. 


The  same  analysis  as  used  in  the  proof  of  Theorem  7  applies  on  a 
U-sintular  subarc  in  V-phase  I  when  v*  =  0 .   As  long  as  (89)  holds,  one 
has  three  options  similar  to  those  of  part  II  of  Theorem  7. 
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5.2.4.   Filling  in  a  Void. 

We  have  emphasized  that   H,  p(t)  ,   and   q(t)   are  continuous  function 
of  time  except  at  manifolds  of  discontinuity  of  both  U*  and  V*   (see  Section 

4.3  above).   From  Theorem  7  it  follows  that  a  void  must  exist  in  the  field  of 

*  * 

extremals  when  these  functions  are  continuous  and  b  p  (x  )x  <  b  (-q  (x  ))y9« 

At  t  ,   moreover,   v*   changes  (as  we  progress  backwards  in  time)  from  1  to  0 

and   u*   from  b_/(b1+b9)   to  a  different  value.   Thus,  we  have  a  manifold  of 

discontinuity  of  both  U*  and  V*.   Moreover,  considering  results  given  above, 

it  is  readily  shown  that  u*(x)   remains  for  increasing  t   (i.e.  backwards 

time)  equal  to  zero  once  it  changes  to  zero.   Then  from  Theorems  6  and  7  it 

*-  *_ 

follows  that  for  b.p~(x   )x_  <  b0(-q„(x   ))y~   the  dual  variables  must  be 

12  v   2    2   2  v   y  2 

*        I* 

discontinuous  to  fill  in  the  void,  and  we  must  have  u*(x)  =  1   for  x   <  x  <  x 

v        u 

Furthermore,  considering  Figure  6  and  considerations  "in  the  large,"  the  mani- 
fold of  discontinuity  must  lie  on  the  V-transition  surface. 

Thus,  we  have  established  that  for  a  by  =  a19b_y9  we  have 


u*(xv)  =  b2/(b1+b2),  ,  u*(x+)  =  1, 

1  and  + 

1  v*(x  )  =  1  l  v*(x  )  =  0. 


(Ill) 


9x        3x 

v     A  v 

and 


It  remains  to  determine  the  function  x  (x,y)   of  (91)  so  that 

v  **  *~  3x        dy^ 

may  be  computed,  and  the  jumps  in  H,  p,   and  q   subsequently  determined  (see 
(92)  through  (95)).   It  should  be  clear  that  it  is  impossible  to  explicitly 
determine   x  (x,y).   However,  by  computation  of  five  points  on  the  V-transition 
surface,  the  desired  partial  derivatives  may  be  estimated  by  using  linear 
approximations  to  the  appropriate  directional  derivatives  and  solving  a  system 
of  four  linear  equations  in  four  unknowns.   For  parameter  set  2  (as  the  reference 
case),  this  yielded  the  following  estimates 
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3x 


3t 


~-^  =  0.0000, 


=  -0.295, 


3t 


=  -0.0167, 


3x 

] 

3y. 


=  -0.0331 


It   is,    therefore,    convenient   to   re-write   the  jump   conditions  across 
the  manifold  of  discontinuity  of  both     U*     and     V*. 

9t 


P1(V   =P1(V' 


p2(Tv>  =  p2(V  -  p  ae 


+  8x 

W    =  W   "P    3yf-aailbr 


(113) 


q2(V    =q2(V    "P    ay^+aal2b2' 

where     p      and     a     are   related  by    (98).      In  this  case   the   jumps    (99)   and    (100) 
in  the  switching   functions   simplify   to 


Su<\>    -  4ll(bl)2yl  +  al2(b2)2^2  + 


all(bl)2ylX2 


3t 


3t 


b,y 


-  b.y. 


["l'l    3y1  VI    3y 


3t 


v 


3t 
(1"a2y2    3x^  -  blylX2    3YlJ 


(114) 


and 


3t 

alla2(bl)2ylX2^7a 

S  (t  )  =  5 L-r~ 

v  v    r       3x  3t 


i-a0y 


v 


-  ^y.x, 


v 


2J2  3x2    1/1  2  3y;L 


(115) 


41  ^_J_ 

Since  v*(t   )  =  0,   we  must  have  S  (t   )  ^  0   so  that  (112)  and  (115) 
'ield  that  a  £  0.   It  should  be  clear  that  a  =  0   if  and  only  if  H,   £,  and 
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*  *+ 

q   are  continuous  at   t  .   For  o  >  0,   the  condition  that  u*(t   )  =  1  yields 
*  v  v 

that  we  must  have 

S  (t  +) 

^^->0,  (116) 

*+ 

where   S  (t   )   is  given  by  (114).   Although  it  cannot  in  general  be  guaranteed 

that  (116)  will  always  hold  when  a  void  in  the  field  of  extremals  such  as  that 
shown  in  Figure  6  exists,  it  should  be  clear  that  it  must  if  the  problem  (64) 
is  to  have  a  solution.   The  author  conjectures  that  this  is  true.   It  is  readily 
shown  that  when  (116)  holds,  we  have 

JL  I  O         JL  I  JL  i 

S  (t   )  >  0,     S  (t   )  <  0,     and     S  (t   )  <  0.        (117) 

U   V  U   V  V   V 

As  we  have  shown  in  our  past  work  (see  Appendix  A) ,  the  appropriate 
value  for  a   is  determined  by  "considerations  in  the  large":   the  structure 

of  the  entire  field  of  extremals  determines  the  value  of  this  parameter.   In 

I* 

Figure  7,  we  let   t    denote  the  backwards  time  at  which  the  U-singular  subarc 

I* 

is  entered  in  V-Phase  I.   Corresponding  to  t    is  a*,  which  yields  the 

first  and  second  conditions  (86)  and  (87)  (with  u*  £  1)   for  a  U-singular 

T  A      * 

subarc  with  V*  =  0  at  t   >  t  .   For  0  <  o   <   a*,   one  uses   u*(x)  =  1   for 

u     v 

*+        I  I 

x   <  t  <  t   and  then  u*(x)  =  0   for  x  >  t  .   For  a   >  o* ,   the   U-switching 
v         u  u 

function  S  (t)   never  changes  sign  so  that   u*(t)  =  1   for  all  T  >  t  .   Thus, 
by  manipulation  of  a,   one  may  fill  in  the  void  in  the  field  of  extremals  in 
V-Phase  I.   The  resulting  field  of  extremals  is  shown  in  Figure  7. 

5.2.4.   The  Case  of  Negligible  Y   Small  Arms  Effectiveness. 

It  seems  appropriate  to  consider  what  happens  to  the  solution  to  the 
problem  at  hand  as  the  (relative)  effectiveness  of  Y    (small  arms)  fire 
becomes  negligible,  i.e.  as   a..   ->■  0.   Let  us  consider  (either)  Figure  5  (or 
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40  20 

Backwards  Time,      t      (minutes) 


T  =  0 

(t=T) 


Figure  7.   Filled-In  Void  in  Field  of  Extremals 
For  Parameter  Set  2. 
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Figure  7).   The   U-singular  "surface"  in  V-Phase  II  has  equation  y  /y„  = 
a..b  /(a  ^b  ).   Thus,  as   a _  _  ■>  0  with  the  other  parameters  being  held  con- 
stant, this  singular  "surface"  appears  higher  and  higher  on  the  y,ly~     axis 
in  Figure  5.   In  the  limit,  the  singular  surface  does  not  appear  in  the  finite 
part  of  the  plane.   Thus,  we  have  shown  that  an  optimal  strategy  in  which  a 
side  divides  the  fire  of  its  supporting  weapon  system  between  the  enemy's 
primary  (infantry)  and  supporting  systems  can  only  occur  when  the  enemy's 
infantry  has  some  effectiveness  (in  the  sense  of  a  non-zero  Lanchester  attri- 
tion-rate coefficient)  against  his  infantry. 

6 .   Discussion. 

In  this  section  we  discuss  what  we  have  learned  about  the  dependence 
of  the  structure  of  optimal  fire-support  strategies  upon  model  form  from  our 
examination  of  the  problems  at  hand.   We  studied  two  aspects  in  this  appendix: 
(1)   the  relationship  between  the  criterion  functional  and  the  structure  of 
optimal  fire-support  strategies  in  Kawara's  fire  support  differential  game 
[16],  and  (2)   a  different  attrition  form  for  casualties  produced  by  the 
attacker's  fire  support. 

We  first  examined  for  what  class  of  criterion  functionals  (terminal 
payoff  only)  the  optimal  fire-support  strategies  (at  least  for  the  case  in  which 
neither  side's  supporting  units  are  all  lost)  are  independent  of  force  levels. 
This  was  done  for  the  same  combat  dynamics  as  considered  by  Kawara  [16].   In 
this  examination,  we  introduced  a  general  approach  for  such  determinations. 
We  determined  the  most  general  form  of  terminal  payoff  with  only  infantries 
considered  in  the  criterion  functional  for  which  optimal  fire-support  strate- 
gies are  independent  (as  qualified  above)  of  force  levels.   The  criterion 
functional  considered  by  Kawara  [16]  is  a  special  case  of  this  general  form 
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of  terminal  payoff.   Thus,  Kawara  [16]  essentially  used  the  only  objective 
function  that  yields  the  results  reported  by  him.   For  any  other  form  of 
terminal  payoff,  the  (forwards)  time  at  which  a  side  changes  from  concentra- 
tion of  all  fire  on  the  enemy's  supporting  units  (counter-battery  fire)  to 
his  primary  ones  in  following  an  optimal  strategy  will  depend  upon  the  force 
levels.   Finally,  we  showed  that  there  is  no  "simple"  type  of  terminal  payoff 
which  includes  both  sides'  infantry  and  artillery  and  yields  optimal  fire- 
support  strategies  which  are  independent  of  force  levels. 

We  finally  examined  the  dependence  of  optimal  fire-support  strategies 
upon  the  form  of  the  combat  attrition  model  by  considering  slightly  different 
combat  dynamics  than  those  considered  by  Kawara  [16]:  we  let  the  attacker's 
(X's)   artillery  produce  "linear-law"  attrition  against  both  the  defender's 
artillery  as  well  as  infantry.   As  contrasted  with  the  optimal  strategies  in 
Kawara' s  problem  [16]  of  always  concentrating  all  artillery  fire  on  first  enemy 
artillery  and  then  enemy  infantry,  for  our  problem  (64)  the  optimal  strategy 
of  one  combatant   (X)   depends  directly  on  the  enemy's  force  levels  and  is  no 
longer  to  always  concentrate  all  fire  on  either  the  enemy's  primary  or  secondary 
weapon  system.   The  solution  to  (64)  is  characterized  by  the  presence  of  singu- 
lar surfaces  (a  different  one  for  each  V-Phase  of  battle).   When  the  system 
state  reaches  one  of  these  surfaces,   X  follows  a  strategy  of  dividing  his 
artillery  fire  between  enemy  infantry  and  artillery  in  order  to  avoid  "overkill." 
Another  aspect  of  optimal  fire-support  strategies  not  present  in  Kawara 's 
problem  [16]  which  occurs  in  the  problem  at  hand  (64)  is  that   X's   strategy 
depends  upon  the  optimal  fire-support  strategy  of  Y.   In  fact,   X  must  react 
instantaneously  to  changes  in  Y's  optimal  strategy. 
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It  should  be  pointed  out  that  the  development  of  even  a  partial 
solution  to  (64)  involved  solution  phenomena  not  previously  encountered  in  a 
Lanchester-type  differential  game:   the  adjoint  (or  dual)  variables   are 
discontinuous  on  a  manifold  of  discontinuity  of  both  U*  and  V*.   This 
manifold  of  discontinuity  exists  for  a  certain  range  of  parameter  values  in 
the  solution  to  the  problem  at  hand.   Furthermore,  there  is  a  military  inter- 
pretation to  this  manifold  of  discontinuity:   if  Y„   concentrates  fire  on 
X_  and  X»  on  Y  ,   then  when  Y   changes  to  concentrating  all  fire  on 
X..  ,   X  must  re-evaluate  the  worth  of  a  Y9   unit  because  it  now  has  a  direct 
influence  on  the  payoff.   Such  discontinuities  in  the  dual  variables  are  unique 
to  differential  games  (see  Appendix  A) . 

It  should  also  be  pointed  out  that  the  presence  of  the  singular  surfaces 
in  the  solution  to  (64)  is  independent  of  the  form  of  the  criterion  functional 
(here  terminal  payoff)  and  depends  only  on  the  combat  dynamics.   For  purposes 
of  comparison,  we  considered  the  same  payoff  as  considered  by  Kawara  [16]. 
We  also  showed  that  the  singular  surfaces  can  only  be  present  in  the  solution 
when  the  defender's  infantry   (Y  )   has  a  (non-zero)  casualty  producing  capa- 
bility against   X  . 

The  problem  (64)  considered  in  this  appendix  has  certain  similarities 
to  the  "War  of  Attrition  and  Attack:   Second  Version"  considered  by  R.  Issacs 
(see  pp.  330-335  of  [15]).   We  have,  however,  developed  a  much  more  complete 
solution  to  the  problem  at  hand.   Although  this  problem  (64)  possesses  some 
similarities  to  the  Lanchester-type  optimal  control  problem  studied  by  us  in 
[26],  its  solution  has  turned  out  to  be  much  more  complex.   It  should  be  pointed 


t 
The  reader  should  recall  that  these  represent  the  marginal  values  of  force  types, 

3V 
i.e.   p?(t)  = -r~ r-  where  V  =  V(t,x,yJ   denotes  the  value  of  the  differential 

Z.  O  A  ,y  \  L  ) 

game  (see  [10],  [15]). 
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out,  however,  that  our  developments  in  this  appendix  have  been  materially 
aided  by  intuition  developed  through  the  study  of  the  simpler,  one-sided 
problem  (see  [27]  for  a  further  discussion). 

As  a  result  of  our  investigation  here,  we  hope  that  a  better  under- 
standing of  optimal  fire-support  strategies  has  been  developed.   Our  work  here 
shows  that  the  nature  of  the  functional  form  of  the  artillery  casualty  rates 
essentially  determines  the  most  significant  aspects  of  the  structure  of 
optimal  strategies.   Thus,  examination  of  these  optimization  problems  shows 
the  importance  of  determining  the  appropriate  (Lanchester-type)  model  of 
combat  dynamics. 

Finally,  it  should  be  pointed  out  that  computational  work  on  the  problem 
(64)  has  not  been  completed  at  the  time  of  this  report.   Due  to  the  theoretical 
complexities  (especially  the  discontinuity  in  the  dual  variables),  student 
project  work  on  numerical  examples  was  not  completed.   We  would  propose  to 
ONR  the  completion  of  this  computational  work  as  a  future  research  task. 
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